-- Logs begin at Tue 2022-05-17 17:22:57 UTC, end at Tue 2022-05-17 18:41:38 UTC. -- May 17 18:08:20.624571 dv-cinder-837362-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 18:08:20.632349 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 18:08:20.635452 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 18:08:20 2022] *** May 17 18:08:20.635452 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 18:08:20.635452 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 18:08:20.635452 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: nodename: dv-cinder-837362-2-iscsi May 17 18:08:20.635452 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: machine: x86_64 May 17 18:08:20.635452 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: clock source: unix May 17 18:08:20.635452 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: pcre jit disabled May 17 18:08:20.635452 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: detected number of CPU cores: 4 May 17 18:08:20.635452 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: current working directory: / May 17 18:08:20.635452 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: detected binary path: /usr/bin/uwsgi-core May 17 18:08:20.636063 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: your processes number limit is 47680 May 17 18:08:20.636063 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: your memory page size is 4096 bytes May 17 18:08:20.636063 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: detected max file descriptor number: 2048 May 17 18:08:20.636063 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: lock engine: pthread robust mutexes May 17 18:08:20.636063 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: thunder lock: enabled May 17 18:08:20.636063 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 18:08:20.636063 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 18:08:20.679985 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: Python main interpreter initialized at 0x55b3cb6569c0 May 17 18:08:20.679985 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: python threads support enabled May 17 18:08:20.679985 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: your server socket listen backlog is limited to 100 connections May 17 18:08:20.679985 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: your mercy for graceful operations on workers is 90 seconds May 17 18:08:20.680364 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: mapped 403077 bytes (393 KB) for 2 cores May 17 18:08:20.680440 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: *** Operational MODE: preforking *** May 17 18:08:20.680665 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: *** uWSGI is running in multiple interpreter mode *** May 17 18:08:20.680665 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: spawned uWSGI master process (pid: 102733) May 17 18:08:20.680863 dv-cinder-837362-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 18:08:20.681686 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: spawned uWSGI worker 1 (pid: 102734, cores: 1) May 17 18:08:20.681793 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: spawned uWSGI worker 2 (pid: 102735, cores: 1) May 17 18:08:20.681919 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 18:08:21.867258 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 18:08:21.869514 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 18:08:22.597344 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:08:22.597344 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: from cryptography.utils import int_from_bytes May 17 18:08:22.597753 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:08:22.597753 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: from cryptography.utils import int_from_bytes May 17 18:08:22.597906 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:08:22.597906 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: from cryptography.utils import int_from_bytes May 17 18:08:22.598217 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:08:22.598217 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: from cryptography.utils import int_from_bytes May 17 18:08:25.183041 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 18:08:25.183585 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 18:08:25.183802 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 18:08:25.184162 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 18:08:25.184414 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 18:08:25.184798 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.184901 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 18:08:25.185265 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 18:08:25.185359 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.185445 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.185594 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 18:08:25.185765 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.185964 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 18:08:25.186102 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.186250 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 18:08:25.186411 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.186591 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.186727 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.186919 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.187045 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.187247 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.187370 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.187567 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.187669 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.187897 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.187993 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.188208 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.188308 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837362-2-iscsi {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.188529 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.188618 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.188833 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.188927 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.189143 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.189245 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.189414 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.189549 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.189756 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.189851 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.190077 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.190249 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837362-2-iscsi {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.190385 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.190480 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.190693 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.190875 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.190996 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.191314 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.191418 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.191624 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.191718 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.192000 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.192113 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.192267 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.192355 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.193359 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.193639 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.193757 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.193953 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.194050 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.194271 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.194372 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.194586 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.194696 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.194896 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.194991 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.195223 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.195319 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837362-2-iscsi {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.195538 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.195635 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.195862 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.195967 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.196187 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.196334 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.196497 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.196655 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.196812 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.196910 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.197167 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.197261 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837362-2-iscsi {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.197503 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.197690 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.197826 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.197921 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.198132 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.198227 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.198456 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.198558 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.198772 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.198870 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.199087 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.199182 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.199403 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.199498 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.199702 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.199790 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.200007 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.200095 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.200318 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.200406 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.200632 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.200727 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.200934 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.201036 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.201235 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.201322 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.201503 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.201592 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.201812 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.201913 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.202129 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.202216 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.202446 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.202540 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.202765 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.202865 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.203003 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.203117 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.203258 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.203344 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.203549 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.203647 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.203863 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.203957 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.204167 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.204275 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.204474 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.204573 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.204773 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.204871 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.205025 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.205131 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.205342 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.205436 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.205680 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.205779 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.205985 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.206086 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.206287 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.206428 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.206594 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.206688 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.206904 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.207001 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.207210 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.207297 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.207513 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.207598 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.207816 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.207910 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.208663 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.208815 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.209000 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.209095 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.209321 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.209425 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.209675 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.209763 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.209989 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.210079 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.210311 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.210452 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.210624 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.210709 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.210942 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.211028 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.211247 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.211343 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.211553 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.211647 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.211858 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.211958 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.212177 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.212265 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.212497 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.212590 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.212797 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.212896 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.213046 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.213132 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.213344 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.213431 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.213674 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.213777 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.213990 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.214078 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.214298 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.214400 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.214605 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.214726 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.214877 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.214976 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.215183 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.215271 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.215486 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.215587 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.215791 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.215887 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.216095 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.216182 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.216402 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.216496 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.216704 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.216800 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.217002 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.217088 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.217303 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.217390 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.217630 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.217719 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.217936 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.218030 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.218244 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.218348 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.218552 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.218639 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.218854 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.218954 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.219158 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.219245 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.219459 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.219566 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.219761 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.219858 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.220076 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.220170 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.220386 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.220479 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.220691 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.220780 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.220997 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.221085 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.221298 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.221384 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.221625 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.221716 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.221940 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.222035 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.222246 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.222333 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.222548 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.222645 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.222861 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.222964 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.223159 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.223253 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.223463 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.223548 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.223797 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.223898 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.224103 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.224196 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.224407 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.224508 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.224711 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.224810 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.225012 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.225098 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.225313 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.225408 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.225640 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.225741 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.225942 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.226030 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.226243 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.226338 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.226542 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.226632 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.226856 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.226944 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.227173 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.227279 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.227476 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.227563 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.227777 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.227863 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.228080 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.228175 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.228382 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.228469 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.228699 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.228787 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.229017 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.229106 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.229327 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.229415 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.229657 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.229765 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.229965 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.230066 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.230286 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:08:25.230373 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.230612 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.230697 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.230923 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.231018 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.231237 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.231330 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.231560 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.231656 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.231870 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.231956 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.232180 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.232267 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.232490 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.232585 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.232805 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.232892 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.233122 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.233210 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.233447 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.233629 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.233783 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.233878 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.234097 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.234209 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.234411 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.234512 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.234733 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.234873 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.235034 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.235134 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.235357 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.235458 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.235674 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.235760 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.235982 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.236068 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.236303 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.236398 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.236616 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.236704 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.236937 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.237031 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.237258 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.237345 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.237600 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.237690 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.237912 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.237998 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.238224 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.238313 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.238535 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.238623 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.238855 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.238950 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.239183 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.239278 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.239532 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.239627 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.239847 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.239936 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.240162 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.240257 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.240474 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.240569 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.240796 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.240894 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.241107 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.241201 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.241418 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.241562 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.241764 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.241863 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.242077 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.242172 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.242389 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.242479 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.242700 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.242797 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.243010 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.243108 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.243319 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.243406 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.243630 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.243731 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.243940 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.244048 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.244244 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.244340 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.244545 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.244633 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.244848 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.244984 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.245158 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.245245 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.245480 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.245574 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.245793 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.245890 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.246102 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.246191 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.246408 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.246495 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.246713 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.246801 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.247024 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.247113 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.247330 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.247426 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.247637 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.247722 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.247944 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.248046 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.248249 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.248343 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.248561 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.248649 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.248872 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.248968 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.249176 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.249270 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.249505 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.249607 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.249815 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.249912 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.250120 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.250207 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.250434 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.250536 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.250735 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.250835 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.251040 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.251130 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.251349 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.251435 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.251658 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.251758 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.251968 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.252056 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.252277 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.252362 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.252587 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.252681 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.252892 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.252986 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.253204 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.253290 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.253536 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.253637 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.253849 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.253946 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.254164 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.254261 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.254475 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.254562 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.254796 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.254883 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.255636 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.255740 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.255950 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.256037 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.256254 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.256341 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.256562 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.256663 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.256864 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.256960 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.257168 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.257262 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.257495 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.257606 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.257801 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.257889 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.258103 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.258189 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.258404 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.258500 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.258703 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.258790 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.259002 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.259090 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.259302 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.259397 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.259609 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.259695 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.259914 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.260007 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.260215 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.260310 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.260516 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.260602 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.260819 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.260906 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.261124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.261220 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.261445 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.261570 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.261776 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.261874 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.262082 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.262171 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.262394 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.262482 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.262697 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.262794 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.263023 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.263109 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.263335 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.263421 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.263641 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.263740 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.263953 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.264044 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.264299 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.264386 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.264612 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.264708 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.264924 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.265011 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.265230 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.265323 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.265573 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.265684 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.265883 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.265972 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.266196 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.266282 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.266502 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.266598 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.266820 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.266906 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.267122 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.267220 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.267434 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.267569 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.267745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.267831 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.268068 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.268157 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.268380 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.268481 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.268695 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.268787 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.268999 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.269085 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.269309 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.269403 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.269640 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.269728 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.269953 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.270042 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.270263 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.270351 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.270618 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.271199 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.271437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.271543 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.271746 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.271834 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.272056 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.272150 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.272364 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.272460 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.272673 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.272760 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.272979 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.273069 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.273296 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.273394 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.273622 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.273712 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.273935 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.274023 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.274242 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.274343 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.274566 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.274654 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.274871 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.274964 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.275181 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.275353 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.275483 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.275570 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.275797 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.275894 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.276101 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.276189 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.276407 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.276495 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.276709 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.276803 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.277060 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.277156 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.277338 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.277425 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.277674 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.277771 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.277980 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.278068 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.278288 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.278377 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.278589 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.278677 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.278891 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.278978 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.279194 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.279287 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.279496 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.279594 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.279796 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.279883 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.280104 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.280196 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.280409 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.280510 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.280715 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.280808 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.281018 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.281104 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.281323 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.281423 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.281648 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.281736 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.281951 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.282056 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.282269 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.282365 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.282576 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.282663 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.282876 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.282970 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.283179 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.283267 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.283482 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.283576 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.283787 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.283909 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.284109 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.284255 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.284411 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.284497 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.284712 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.284798 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.285016 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.285105 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.285319 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.285413 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.285659 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.285747 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.285972 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.286077 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.286804 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.286898 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.287121 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.287217 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.287432 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.287519 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.287738 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.287824 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.288048 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.288143 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.288355 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.288441 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.288662 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.288748 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.288971 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.289068 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.289279 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.289368 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.289606 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.289709 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.289917 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.290017 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.290225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.290310 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.290528 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.290615 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.290837 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.290932 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.291150 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.291237 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.291455 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.291711 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.291807 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.292042 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.292129 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.292357 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.292450 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.292663 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.292758 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.292981 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.293075 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.293299 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.293558 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.293660 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.293898 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.293994 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.294218 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.294305 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.294539 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.294636 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.294863 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.294959 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.295184 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.295269 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.295490 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.295579 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.295803 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.295940 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.296107 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.296196 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.296415 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.296512 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.296719 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.296814 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.297026 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.297115 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.297329 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.297497 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.297656 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.297757 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.297959 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.298056 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.298258 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.298353 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.298560 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.298656 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.298861 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.298947 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.299163 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.299252 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.299463 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.299624 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.299765 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.299851 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.300069 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.300165 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.300368 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.300464 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.300675 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.300763 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.300978 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.301065 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.301282 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.301383 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.301626 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.301717 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.301989 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.302078 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.302303 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.302394 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.302611 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.302716 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.302915 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.303003 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.303231 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.303329 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.303550 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.303638 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.303849 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.303936 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.304153 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.304242 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.304454 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.304551 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.304762 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.304860 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.305069 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.305167 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.305370 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.305507 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.305737 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.305837 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.306044 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.306139 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.306346 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.306434 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.306658 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.306756 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.306955 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.307041 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.307258 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.307344 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.307557 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.307653 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.307869 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.307962 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.308170 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.308257 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.308471 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.308567 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.308771 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.308858 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.309075 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.309161 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.309378 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.309491 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.309712 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.309808 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.310018 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.310104 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.310317 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.310404 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.310617 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.310710 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.310919 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.311013 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.311221 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.311310 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.311521 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.311607 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.311827 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.311937 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.312129 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.312216 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.312427 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.312521 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.312735 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.312843 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.313036 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.313131 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.313336 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.313429 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.313665 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.313767 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.313973 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.314059 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.314288 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.314387 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.314576 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.314683 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.314882 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.314979 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.315185 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.315272 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.315490 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.315579 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.315792 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.315878 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.316094 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.316185 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.316392 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.316486 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.316694 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.316782 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.316995 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.317090 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.317301 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.317390 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.318400 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.318517 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.318712 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.318834 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.319017 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.319138 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.319324 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.319442 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.319628 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.319746 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.319938 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.320066 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.320242 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.320373 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.320545 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.320677 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.320847 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.320982 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.321148 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.321284 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.321449 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.321679 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.321806 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.321984 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.322072 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.322340 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.322435 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.322643 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.322740 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.322955 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.323042 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.323271 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.323368 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.323582 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.323670 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.323889 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.323974 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.324197 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.324298 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.324500 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.324588 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.324808 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.324894 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.325117 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.325214 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.325426 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.325553 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.325755 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.325842 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.326057 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.326152 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.326371 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.326462 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.326678 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.326764 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.326985 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.327088 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.327287 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.327373 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.327591 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.327686 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.327912 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.328001 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.328210 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.328296 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.328516 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.328611 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.328825 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.328978 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.329129 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.329226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.329436 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.329551 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.329764 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.329853 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.330073 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.330166 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.330381 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.330469 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.330691 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.330779 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.330995 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.331080 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.331302 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.331397 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.331602 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.331688 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.331909 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.332003 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.332216 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.332312 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.332518 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.332606 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.332832 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.332918 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.333186 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.333282 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.333512 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.333603 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.333824 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.333911 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.334128 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.334224 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.334436 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.334521 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.334737 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.334834 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.335037 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.335164 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.335347 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.335473 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.335652 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.335782 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.335972 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.336089 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.336276 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.336412 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.336693 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.336787 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.337002 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.337090 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.337311 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.337396 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.337637 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.337735 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.337950 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.338062 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.338261 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.338377 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.338577 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.338673 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.338892 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.338980 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.339195 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.339283 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.339561 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.339657 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.339870 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.339957 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.340193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.340282 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.340496 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.340592 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.340797 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.340886 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.341098 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.341193 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.341409 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.341558 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.341735 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.341823 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.342052 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.342147 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.342355 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.342464 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.342667 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.342762 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.342990 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.343087 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.343294 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.343464 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.343614 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.343773 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.344028 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.344179 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.344343 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.344434 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.344650 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.344782 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.344995 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.345082 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.345297 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.345386 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.345639 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.345731 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.345952 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.346085 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.346333 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.346634 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.346777 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.346863 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.346944 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.347023 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.347189 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.347286 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.347494 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.347590 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.347814 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.347902 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.348130 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.348234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.348439 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.348528 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.348776 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.348862 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.349085 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.349182 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.349407 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.349517 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.349752 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.349840 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.350066 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.350168 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.350387 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.350476 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.350723 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.350809 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.351028 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.351117 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.351339 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.351440 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.351640 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.351728 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.351945 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.352034 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.352261 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.352358 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.352561 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.352657 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.352869 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.352967 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.353180 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.353277 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.353504 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.353609 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.353810 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.353901 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.354110 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.354206 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.354426 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.354521 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.354723 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.354851 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.355038 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.355125 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.355345 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.355442 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.355650 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.355738 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.355967 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.356066 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.356269 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.356367 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.356587 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.356675 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.356892 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.356979 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.357192 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.357289 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.357518 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.357609 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.357824 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.357911 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.358145 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.358240 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.358451 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.358545 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.358752 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.358846 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.359060 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.359150 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.359367 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.359456 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.359686 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.359773 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.360005 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.360094 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.360326 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.360420 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.360641 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.360729 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.360956 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.361061 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.361267 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.361361 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.361589 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.361693 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.361892 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.361980 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.362201 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.362289 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.362502 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.362605 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.362806 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.362902 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.363108 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.363204 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.363413 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.363510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.363713 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.363802 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.364015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.364103 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.364833 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.364965 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.365139 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.365227 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.365441 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.365543 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.365769 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.365865 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.366074 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.366162 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.366376 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.366464 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.366685 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.366774 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.366987 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.367074 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.367305 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.367392 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.367612 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.367701 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.367917 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.368004 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.368222 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.368354 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.368527 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.368615 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.368856 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.368943 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.369160 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.369256 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.369518 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.369612 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.369812 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.370010 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.370126 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.370225 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.370439 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.370529 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.370750 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.370851 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.371059 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.371155 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.371371 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.371460 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.371683 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.371771 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.371989 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.372085 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.372301 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.372403 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.372614 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.372702 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.372926 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.373014 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.373246 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.373434 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.373583 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.373782 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.373889 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.374095 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.374183 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.374403 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.374504 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.374713 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.374983 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.375117 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.375312 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.375411 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.375617 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.375713 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.375925 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.376016 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.376234 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.376322 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.376544 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.376648 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.376861 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.376959 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.377171 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.377269 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.377503 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.377610 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.377819 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.377908 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.378131 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.378221 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.378441 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.378537 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.378751 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.378840 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.379061 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.379151 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.379397 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.379493 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.379712 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.379806 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.380074 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.380170 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.380388 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.380483 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.380700 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.380798 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.381011 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.381113 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.381322 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.381412 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.381656 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.381755 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.381969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.382068 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.382280 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.382408 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.382591 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.382679 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.382898 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.383000 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.383208 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.383334 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.383522 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.383617 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.383838 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.383935 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.384153 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.384242 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.384465 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.384561 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.384774 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.384870 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.385087 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.385219 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.385398 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.385528 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.385759 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.385939 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.386083 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.386261 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.386399 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.386601 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.386715 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.386927 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.387021 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.387251 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.387535 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.387634 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.387858 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.387947 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.388180 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.388266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.388485 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.388582 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.388788 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.388876 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.389098 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.389186 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.389404 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.389513 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.389741 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.389840 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.390060 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.390156 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.390370 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.390468 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.390671 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.390760 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.390980 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.391067 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.391287 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.391375 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.391610 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.391809 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.391926 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.392148 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.392249 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.392465 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.392553 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.392789 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.392876 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.393111 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.393362 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.393445 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.393730 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.393828 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.394052 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.394150 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.394354 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.394442 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.394660 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.394748 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.394972 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.395077 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.395282 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.395379 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.396115 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.396209 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.396420 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.396510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.396729 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.396826 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.397043 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.397137 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.397343 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.397431 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.397674 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.397771 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.397979 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.398073 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.398289 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.398383 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.398596 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.398682 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.398899 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.398985 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.399200 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.399295 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.399503 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.399598 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.399802 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.399903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.400103 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.400192 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.400404 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.400492 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.400704 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.400803 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.401016 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.401103 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.401315 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.401401 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.401641 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.401743 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.401943 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.402038 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.402245 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.402332 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.402543 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.402639 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.402848 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.402936 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.403155 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.403249 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.403460 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.403605 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.403779 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.403867 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.404078 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.404165 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.404387 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.404480 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.404692 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.404784 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.405010 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.405115 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.405319 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.405420 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.405653 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.405755 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.405969 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.406056 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.406282 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.406372 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.406604 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.406803 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.406917 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.407137 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.407235 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.407455 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.407544 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.407784 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.407872 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.408111 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.408379 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.408467 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.408705 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.409012 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.409143 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.409260 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.409351 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.409432 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.409636 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.409738 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.409946 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.410044 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.410256 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.410354 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.410563 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.410651 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.410870 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.410968 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.411226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.411313 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.411549 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.411637 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.411855 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.411943 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.412163 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.412252 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.412472 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.412560 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.412779 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.412869 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.413085 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.413172 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.413392 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.413520 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.413737 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.413837 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.414053 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.414148 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.414364 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.414519 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.414672 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.414769 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.414984 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.415076 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.415288 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.415384 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.415610 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.415709 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.415914 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.416003 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.416218 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.416317 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.416531 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.416619 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.416836 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.416923 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.417144 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.417277 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.417445 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.417584 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.417782 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.417871 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.418102 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.418191 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.418430 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.418519 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.418745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.418841 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.419050 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.419140 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.419370 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.419456 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.419689 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.419788 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.419997 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.420086 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.420322 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.420419 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.420629 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.420726 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.420952 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.421042 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.421282 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.421370 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.421613 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.421718 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.421936 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.422025 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.422233 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.422319 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.422532 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.422621 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.422832 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.422928 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.423137 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.423224 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.423450 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.423539 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.423754 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.423842 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.424055 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.424143 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.424354 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.424450 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.424659 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.424747 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.424961 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.425058 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.425262 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.425350 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.425585 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.425676 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.425887 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.425987 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.426192 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.426280 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.426491 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.426578 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.427311 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.427414 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.427623 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.427717 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.427920 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.428007 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.428219 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.428317 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.428518 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.428605 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.428820 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.428914 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.429120 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.429217 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.429420 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.429527 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.429744 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.429831 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.430044 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.430206 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.430343 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.430442 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.430644 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.430732 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.430950 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.431040 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.431255 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.431347 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.431559 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.431648 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.431862 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.431953 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.432183 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.432270 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.432489 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.432586 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.432805 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.432930 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.433166 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.433260 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.433432 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.433566 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.433761 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.433893 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.434073 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.434161 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.434381 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.434478 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.434692 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.434779 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.435000 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.435088 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.435307 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.435403 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.435613 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.435699 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.435920 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.436007 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.436232 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.436320 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.436544 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.436633 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.436844 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.436930 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.437154 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.437242 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.437481 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.437573 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.437805 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.437892 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.438119 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.438217 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.438422 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.438510 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.438744 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.438841 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.439055 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.439143 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.439364 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.439452 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.439677 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.439773 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.439982 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.440070 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.440292 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.440380 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.440604 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.440700 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.440914 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.441000 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.441227 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.441313 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.441560 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.441663 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.441864 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.441952 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.442178 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.442272 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.442541 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.442631 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.442869 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.442958 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.443459 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.443560 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.443768 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.443858 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.444111 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.444224 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.444418 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.444511 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.444729 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.444818 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.445035 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.445123 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.445277 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102734) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 18:08:25.445374 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.445726 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.446041 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.446357 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.446665 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:08:25.446910 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102735) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 18:08:25.468843 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_db.sqlalchemy.engines [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:08:25.470412 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG oslo_db.sqlalchemy.engines [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:08:25.532293 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.context [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc8af911-08c4-433f-ae77-a63829b3d3e3(cell1) {{(pid=102734) load_cells /opt/stack/nova/nova/context.py:464}} May 17 18:08:25.534608 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.context [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc8af911-08c4-433f-ae77-a63829b3d3e3(cell1) {{(pid=102735) load_cells /opt/stack/nova/nova/context.py:464}} May 17 18:08:25.536716 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:08:25.538269 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:08:25.538957 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG oslo_concurrency.lockutils [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:08:25.539067 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:08:25.540552 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG oslo_concurrency.lockutils [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:08:25.540986 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:08:25.541347 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG oslo_concurrency.lockutils [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:08:25.543313 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG oslo_concurrency.lockutils [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102735) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:08:25.552501 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_db.sqlalchemy.engines [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:08:25.555825 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_db.sqlalchemy.engines [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:08:25.559413 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG oslo_db.sqlalchemy.engines [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:08:25.563271 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG oslo_db.sqlalchemy.engines [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:08:25.715698 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_db.sqlalchemy.engines [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102734) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:08:25.722030 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG oslo_db.sqlalchemy.engines [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102735) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:08:26.056673 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: WARNING keystonemiddleware.auth_token [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:08:26.057065 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: WARNING keystonemiddleware.auth_token [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:08:26.064850 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: WARNING keystonemiddleware.auth_token [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:08:26.065286 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: WARNING keystonemiddleware.auth_token [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:08:26.409005 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: WARNING keystonemiddleware.auth_token [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:08:26.416978 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: WARNING keystonemiddleware.auth_token [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:08:26.418594 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: WARNING keystonemiddleware.auth_token [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:08:26.424809 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3cb6569c0 pid: 102734 (default app) May 17 18:08:26.427558 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:08:26.427737 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: WARNING keystonemiddleware.auth_token [None req-8ec88ea4-e640-40e5-9b28-4baedfced03d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:08:26.428184 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] 10.222.0.65 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001795 May 17 18:08:26.428604 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 1/1] 10.222.0.65 () {50 vars in 788 bytes} [Tue May 17 18:08:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:08:26.432163 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b3cb6569c0 pid: 102735 (default app) May 17 18:09:44.021623 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:09:44.022627 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 May 17 18:09:44.023185 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 2/2] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:09:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:09:44.450658 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-628f678f-7768-4ca6-aa86-18975abe3607 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:09:44.480238 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-628f678f-7768-4ca6-aa86-18975abe3607 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.449996 May 17 18:09:44.480889 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 1/3] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 17 18:09:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:09:46.760543 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:09:46.761633 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-31677192-3d6c-44da-87db-a1ca1131ceaa None None] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 17 18:09:46.762211 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 3/4] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:09:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:09:46.823428 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-adc7bb25-3b5f-48eb-8610-b9a564ba198a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "ram": 256, "id": "c1", "name": "cirros256"}} {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:09:46.841880 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:09:46.841880 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: warnings.warn(msg) May 17 18:09:46.871190 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-adc7bb25-3b5f-48eb-8610-b9a564ba198a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.102870 May 17 18:09:46.879310 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 2/5] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 17 18:09:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:09:47.096176 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-95602c10-b6ae-4dff-8883-4f74fe3f7cb0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:09:47.098745 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:09:47.098745 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: warnings.warn(msg) May 17 18:09:47.151136 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-95602c10-b6ae-4dff-8883-4f74fe3f7cb0 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.270236 May 17 18:09:47.152103 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 4/6] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 17 18:09:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:09:49.475034 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-adc7bb25-3b5f-48eb-8610-b9a564ba198a admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:09:49.475996 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-adc7bb25-3b5f-48eb-8610-b9a564ba198a admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 May 17 18:09:49.476398 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 3/7] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:09:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:09:49.579586 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-ddb04f77-fa9b-4a72-b5fe-6b8487583f48 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "ram": 512, "rxtx_factor": 1.0, "vcpus": 1, "disk": 5, "swap": 0}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:09:49.597128 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:09:49.597128 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: warnings.warn(msg) May 17 18:09:49.615229 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-ddb04f77-fa9b-4a72-b5fe-6b8487583f48 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133035 May 17 18:09:49.615781 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 5/8] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 17 18:09:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:09:49.627971 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-76f22be5-be19-439d-90ea-eeb0d5639ade admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:09:49.629684 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:09:49.629684 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: warnings.warn(msg) May 17 18:09:49.664125 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-76f22be5-be19-439d-90ea-eeb0d5639ade admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040385 May 17 18:09:49.664929 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 4/9] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 17 18:09:49 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:09:51.915134 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-ddb04f77-fa9b-4a72-b5fe-6b8487583f48 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:09:51.916146 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-ddb04f77-fa9b-4a72-b5fe-6b8487583f48 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 17 18:09:51.916719 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 6/10] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:09:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:09:51.979986 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-b7b7c0a6-b22b-4e89-a821-37c0e856607c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "id": "d2", "name": "ds1G", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:09:51.998303 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-b7b7c0a6-b22b-4e89-a821-37c0e856607c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076035 May 17 18:09:51.999185 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 5/11] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 17 18:09:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:09:52.010942 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-75e8d443-3140-4cc0-914c-6b67fb7cc610 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:09:52.034692 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-75e8d443-3140-4cc0-914c-6b67fb7cc610 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027327 May 17 18:09:52.035452 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 7/12] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 17 18:09:52 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:09:54.296681 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-b7b7c0a6-b22b-4e89-a821-37c0e856607c admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:09:54.297759 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-b7b7c0a6-b22b-4e89-a821-37c0e856607c admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 May 17 18:09:54.298167 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 6/13] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:09:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:09:54.362634 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-76b18a65-0850-40a6-9c4a-285f85cb0902 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d3", "vcpus": 2, "ram": 2048}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:09:54.382188 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-76b18a65-0850-40a6-9c4a-285f85cb0902 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076929 May 17 18:09:54.382778 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 8/14] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 17 18:09:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:09:54.394261 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-67357a85-0d7e-4df6-9ce9-2e14333e1407 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:09:54.418066 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-67357a85-0d7e-4df6-9ce9-2e14333e1407 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027431 May 17 18:09:54.418644 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 7/15] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 17 18:09:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:09:56.766362 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-76b18a65-0850-40a6-9c4a-285f85cb0902 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:09:56.767833 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-76b18a65-0850-40a6-9c4a-285f85cb0902 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002494 May 17 18:09:56.768245 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 9/16] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:09:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:09:56.835473 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-ef437ae4-2216-44ff-987b-6daa4c2de6eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20}} {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:09:56.861686 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-ef437ae4-2216-44ff-987b-6daa4c2de6eb admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085785 May 17 18:09:56.862289 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 8/17] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 17 18:09:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:09:56.876412 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-1b5e1416-e132-40cf-a571-428f216f2a8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:09:56.914057 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-1b5e1416-e132-40cf-a571-428f216f2a8c admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041075 May 17 18:09:56.916432 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 10/18] 10.222.0.65 () {64 vars in 1335 bytes} [Tue May 17 18:09:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:09:59.251417 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-ef437ae4-2216-44ff-987b-6daa4c2de6eb admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:09:59.253401 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-ef437ae4-2216-44ff-987b-6daa4c2de6eb admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001816 May 17 18:09:59.253845 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 9/19] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:09:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:09:59.340973 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-ed193f94-a6ae-4c43-9bbb-461d427799fc admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:09:59.365772 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-ed193f94-a6ae-4c43-9bbb-461d427799fc admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.104538 May 17 18:09:59.366676 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 11/20] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 17 18:09:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:10:02.024582 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-ef437ae4-2216-44ff-987b-6daa4c2de6eb admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:02.025635 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-ef437ae4-2216-44ff-987b-6daa4c2de6eb admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 17 18:10:02.026038 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 10/21] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:10:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:02.085260 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-a99b20a1-6aa8-4298-a750-dbf9901ae5d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512, "disk": 1, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:02.104107 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-a99b20a1-6aa8-4298-a750-dbf9901ae5d3 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072351 May 17 18:10:02.104903 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 12/22] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 17 18:10:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:10:02.116459 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-d7e74733-5f16-4d55-87ba-107ba0bc8196 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:02.139101 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-d7e74733-5f16-4d55-87ba-107ba0bc8196 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026330 May 17 18:10:02.139702 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 11/23] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 17 18:10:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:10:04.365559 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-a99b20a1-6aa8-4298-a750-dbf9901ae5d3 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:04.366604 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-a99b20a1-6aa8-4298-a750-dbf9901ae5d3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 17 18:10:04.367035 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 13/24] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:10:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:10:04.428372 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-186a010c-dcd5-4096-91d7-bde080fb60c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.small", "disk": 20, "swap": 0, "id": "2", "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:04.447085 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-186a010c-dcd5-4096-91d7-bde080fb60c2 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072922 May 17 18:10:04.447694 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 12/25] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 17 18:10:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:10:04.464744 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-6ce44763-4aba-4e9a-a3af-4d5e8f3ba667 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:04.492089 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-6ce44763-4aba-4e9a-a3af-4d5e8f3ba667 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032835 May 17 18:10:04.492661 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 14/26] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 17 18:10:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:10:07.179677 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-186a010c-dcd5-4096-91d7-bde080fb60c2 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:07.180682 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-186a010c-dcd5-4096-91d7-bde080fb60c2 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 17 18:10:07.181079 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 13/27] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:10:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:07.237701 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-984bbefe-d063-4c6d-8745-33d5c1a91b25 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "vcpus": 2}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:07.254576 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-984bbefe-d063-4c6d-8745-33d5c1a91b25 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.067937 May 17 18:10:07.255269 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 15/28] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 17 18:10:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:10:07.266713 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-9ca17c28-1476-415b-967c-d383d686c979 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:07.288354 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-9ca17c28-1476-415b-967c-d383d686c979 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025457 May 17 18:10:07.289002 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 14/29] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 17 18:10:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:10:09.549953 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-984bbefe-d063-4c6d-8745-33d5c1a91b25 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:09.550992 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-984bbefe-d063-4c6d-8745-33d5c1a91b25 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 May 17 18:10:09.551388 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 16/30] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:10:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:09.610314 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-8b326bea-c258-4346-b12c-9ee4fd8a7030 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "ram": 8192, "swap": 0, "vcpus": 4, "disk": 80, "id": "4"}} {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:09.632152 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-8b326bea-c258-4346-b12c-9ee4fd8a7030 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074865 May 17 18:10:09.632903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 15/31] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 17 18:10:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:10:09.645051 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-7b397bcd-2e98-41ad-8251-a7bd96f13d1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:09.670117 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-7b397bcd-2e98-41ad-8251-a7bd96f13d1d admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028831 May 17 18:10:09.671082 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 17/32] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 17 18:10:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:10:11.965838 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-8b326bea-c258-4346-b12c-9ee4fd8a7030 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:11.966857 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-8b326bea-c258-4346-b12c-9ee4fd8a7030 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 May 17 18:10:11.967239 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 16/33] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:10:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:12.025410 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-56b18541-05d3-4b82-b12a-7279a0679bf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:12.044277 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-56b18541-05d3-4b82-b12a-7279a0679bf4 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.070843 May 17 18:10:12.045250 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 18/34] 10.222.0.65 () {64 vars in 1282 bytes} [Tue May 17 18:10:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:10:12.057366 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-ef75e25d-f917-4ad6-b15c-d93e65bd9f96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:12.083879 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-ef75e25d-f917-4ad6-b15c-d93e65bd9f96 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030394 May 17 18:10:12.084463 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 17/35] 10.222.0.65 () {64 vars in 1332 bytes} [Tue May 17 18:10:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:10:35.882348 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-56b18541-05d3-4b82-b12a-7279a0679bf4 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:35.883354 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-56b18541-05d3-4b82-b12a-7279a0679bf4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 17 18:10:35.883754 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 19/36] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:10:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:35.939015 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-8202f7e1-1bb8-43f6-bc8f-08e5dbd44477 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:35.956359 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-8202f7e1-1bb8-43f6-bc8f-08e5dbd44477 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066790 May 17 18:10:35.956885 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 18/37] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 17 18:10:35 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:10:36.952085 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-56b18541-05d3-4b82-b12a-7279a0679bf4 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:36.953080 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-56b18541-05d3-4b82-b12a-7279a0679bf4 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 May 17 18:10:36.953496 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 20/38] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:10:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:37.148213 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-cb373f41-95f8-40f9-b80c-c87797790b4a admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:37.153646 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.wsgi [None req-cb373f41-95f8-40f9-b80c-c87797790b4a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-cb373f41-95f8-40f9-b80c-c87797790b4a admin admin] Request method failure captured: May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Accept: application/json May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Accept-Encoding: gzip, deflate May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Connection: keep-alive May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Content-Length: 0 May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Host: 10.222.0.65 May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Openstack-Api-Version: compute 2.90 May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Openstack-System-Scope: None May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: User-Agent: python-novaclient May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Auth-Token: gAAAAABig-UcAZbBoH2ZpJVx-gQo4p-5dndsyLd0nuNqo9v6-cxztU6mJdmWICd4yXO7KBXDPH0_eWoU7FkYvCmIb_O1o2SApQYxo1xP5PwYaZQLHJ7quGD1UdoKo1lD3AnK3945fMn16o8NuvDNKWcLikN-Op6iCw9Jqi9S0Lj8_dBBAYL9TZc May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Domain-Id: None May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Domain-Name: None May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Identity-Status: Confirmed May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Is-Admin-Project: True May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Domain-Id: default May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Domain-Name: Default May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Name: admin May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Role: member,reader,admin May 17 18:10:37.156822 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Roles: member,reader,admin May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Tenant: admin May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Tenant-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Tenant-Name: admin May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User: admin May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Domain-Id: default May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Domain-Name: Default May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Id: 8763b2e915c44d8688900867e35dfda6 May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Name: admin May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: method: > May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: exception: Flavor 42 could not be found. May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: action_args: {'id': '42'} May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:10:37.158599 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:37.159903 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:37.161266 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-cb373f41-95f8-40f9-b80c-c87797790b4a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:10:37.162681 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-cb373f41-95f8-40f9-b80c-c87797790b4a admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.059740 May 17 18:10:37.162681 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 19/39] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 17 18:10:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 18:10:37.168221 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-be530cce-2268-4ae5-8e52-86b869ead9a1 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:37.190787 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-be530cce-2268-4ae5-8e52-86b869ead9a1 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026365 May 17 18:10:37.191321 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 21/40] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 17 18:10:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:10:37.201104 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-884090e8-3bae-4e20-b29d-3bd6c0364ef3 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:37.222512 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-884090e8-3bae-4e20-b29d-3bd6c0364ef3 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024929 May 17 18:10:37.223027 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 20/41] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 17 18:10:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:10:37.231906 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-553f42e7-ac8f-475f-9f55-7dafa5e196f5 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:37.237250 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.wsgi [None req-553f42e7-ac8f-475f-9f55-7dafa5e196f5 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-553f42e7-ac8f-475f-9f55-7dafa5e196f5 admin admin] Request method failure captured: May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Accept: application/json May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Accept-Encoding: gzip, deflate May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Connection: keep-alive May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Content-Length: 0 May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Host: 10.222.0.65 May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Openstack-Api-Version: compute 2.90 May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Openstack-System-Scope: None May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: User-Agent: python-novaclient May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Auth-Token: gAAAAABig-UcAZbBoH2ZpJVx-gQo4p-5dndsyLd0nuNqo9v6-cxztU6mJdmWICd4yXO7KBXDPH0_eWoU7FkYvCmIb_O1o2SApQYxo1xP5PwYaZQLHJ7quGD1UdoKo1lD3AnK3945fMn16o8NuvDNKWcLikN-Op6iCw9Jqi9S0Lj8_dBBAYL9TZc May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Domain-Id: None May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Domain-Name: None May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Identity-Status: Confirmed May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Is-Admin-Project: True May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Domain-Id: default May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Domain-Name: Default May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Name: admin May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Role: member,reader,admin May 17 18:10:37.240437 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Roles: member,reader,admin May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Tenant: admin May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Tenant-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Tenant-Name: admin May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User: admin May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Domain-Id: default May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Domain-Name: Default May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Id: 8763b2e915c44d8688900867e35dfda6 May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Name: admin May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: method: > May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: exception: Flavor 42 could not be found. May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: action_args: {'id': '42'} May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:10:37.241977 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:37.242938 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:37.244225 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-553f42e7-ac8f-475f-9f55-7dafa5e196f5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102734) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:10:37.245436 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-553f42e7-ac8f-475f-9f55-7dafa5e196f5 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.013373 May 17 18:10:37.245436 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 22/42] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 17 18:10:37 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 18:10:38.127568 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-884090e8-3bae-4e20-b29d-3bd6c0364ef3 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:38.128561 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-884090e8-3bae-4e20-b29d-3bd6c0364ef3 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 May 17 18:10:38.128951 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 21/43] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:10:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:38.314999 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-a9398c4e-d159-48da-b6e5-0ed1a6110db9 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:38.320411 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.wsgi [None req-a9398c4e-d159-48da-b6e5-0ed1a6110db9 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-a9398c4e-d159-48da-b6e5-0ed1a6110db9 admin admin] Request method failure captured: May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Accept: application/json May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Accept-Encoding: gzip, deflate May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Connection: keep-alive May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Content-Length: 0 May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Host: 10.222.0.65 May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Openstack-Api-Version: compute 2.90 May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Openstack-System-Scope: None May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: User-Agent: python-novaclient May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Auth-Token: gAAAAABig-UejWJIIA_2WnQuzA1hLSN0pZt787j3cchrDVyvT8UDr5cAO2xu0L5A7hJxUWcyQt10HKa0MDAUJDrE_v0-TtGyV1G2E-xFUAWe2ZRSc0ff5GqNvZn4ZaMBa6mL5lHO9FOKSVmgw_ipJ4ofcb3VLQkBkjvndskBOFrFpBZ6oSR4e_E May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Domain-Id: None May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Domain-Name: None May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Identity-Status: Confirmed May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Is-Admin-Project: True May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Domain-Id: default May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Domain-Name: Default May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Name: admin May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Role: member,reader,admin May 17 18:10:38.321969 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Roles: member,reader,admin May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Tenant: admin May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Tenant-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Tenant-Name: admin May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User: admin May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Domain-Id: default May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Domain-Name: Default May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Id: 8763b2e915c44d8688900867e35dfda6 May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Name: admin May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: method: > May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: exception: Flavor 84 could not be found. May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: action_args: {'id': '84'} May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:10:38.323478 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:38.324526 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:38.326015 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-a9398c4e-d159-48da-b6e5-0ed1a6110db9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102734) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:10:38.327365 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-a9398c4e-d159-48da-b6e5-0ed1a6110db9 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059010 May 17 18:10:38.327365 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 23/44] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 17 18:10:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 18:10:38.333433 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-d03a4a8f-3f50-4649-a92b-bbc6bd52833b admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:38.347463 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-d03a4a8f-3f50-4649-a92b-bbc6bd52833b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018107 May 17 18:10:38.347925 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 22/45] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 17 18:10:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:10:38.356775 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-b4a1c1ec-99de-40ad-b78f-f82431094a9e admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:38.370081 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-b4a1c1ec-99de-40ad-b78f-f82431094a9e admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016696 May 17 18:10:38.370596 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 24/46] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 17 18:10:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:10:38.379350 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-a1e69afd-0094-4c57-967d-0768114f821d admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:38.385035 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.wsgi [None req-a1e69afd-0094-4c57-967d-0768114f821d admin admin] HTTP exception thrown: Flavor 84 could not be found. May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-a1e69afd-0094-4c57-967d-0768114f821d admin admin] Request method failure captured: May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Accept: application/json May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Accept-Encoding: gzip, deflate May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Connection: keep-alive May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Content-Length: 0 May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Host: 10.222.0.65 May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Openstack-Api-Version: compute 2.90 May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Openstack-System-Scope: None May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: User-Agent: python-novaclient May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Auth-Token: gAAAAABig-UejWJIIA_2WnQuzA1hLSN0pZt787j3cchrDVyvT8UDr5cAO2xu0L5A7hJxUWcyQt10HKa0MDAUJDrE_v0-TtGyV1G2E-xFUAWe2ZRSc0ff5GqNvZn4ZaMBa6mL5lHO9FOKSVmgw_ipJ4ofcb3VLQkBkjvndskBOFrFpBZ6oSR4e_E May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Domain-Id: None May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Domain-Name: None May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Identity-Status: Confirmed May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Is-Admin-Project: True May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Domain-Id: default May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Domain-Name: Default May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Name: admin May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Role: member,reader,admin May 17 18:10:38.386745 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Roles: member,reader,admin May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Tenant: admin May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Tenant-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Tenant-Name: admin May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User: admin May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Domain-Id: default May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Domain-Name: Default May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Id: 8763b2e915c44d8688900867e35dfda6 May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Name: admin May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: method: > May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: exception: Flavor 84 could not be found. May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: action_args: {'id': '84'} May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:10:38.388234 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:38.389226 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:38.390488 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-a1e69afd-0094-4c57-967d-0768114f821d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:10:38.392322 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-a1e69afd-0094-4c57-967d-0768114f821d admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012314 May 17 18:10:38.392322 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 23/47] 10.222.0.65 () {60 vars in 1190 bytes} [Tue May 17 18:10:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 17 18:10:39.264300 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-b4a1c1ec-99de-40ad-b78f-f82431094a9e admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:39.265385 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-b4a1c1ec-99de-40ad-b78f-f82431094a9e admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 17 18:10:39.265809 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 25/48] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:10:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:39.451471 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-691ff901-78a6-4825-a819-b39255a8bc04 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:39.457120 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.wsgi [None req-691ff901-78a6-4825-a819-b39255a8bc04 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-691ff901-78a6-4825-a819-b39255a8bc04 admin admin] Request method failure captured: May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Accept: application/json May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Accept-Encoding: gzip, deflate May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Connection: keep-alive May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Content-Length: 0 May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Host: 10.222.0.65 May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Openstack-Api-Version: compute 2.90 May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Openstack-System-Scope: None May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: User-Agent: python-novaclient May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Auth-Token: gAAAAABig-UfXGZ9OooStDmmzDMd_SZgmls9G0HeMMhO3GmCNxBdsrUpOYrMAfvednTtvEBrJobL-p3Ra4xX6BNolVluel8AVioszzsIBf2XBYZhRCMteY2_gbetoWEtjrApczs8mZXW5wgRx48Cb-Siy5470q8HLh3nsUu0j4J8MuITz8d6IAk May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Domain-Id: None May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Domain-Name: None May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Identity-Status: Confirmed May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Is-Admin-Project: True May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Domain-Id: default May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Domain-Name: Default May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Project-Name: admin May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Role: member,reader,admin May 17 18:10:39.458642 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Roles: member,reader,admin May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Tenant: admin May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Tenant-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-Tenant-Name: admin May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User: admin May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Domain-Id: default May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Domain-Name: Default May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Id: 8763b2e915c44d8688900867e35dfda6 May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: X-User-Name: admin May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: method: > May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: exception: Flavor 451 could not be found. May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: action_args: {'id': '451'} May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:10:39.460157 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:39.461124 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: ERROR nova.api.openstack.wsgi May 17 18:10:39.462510 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-691ff901-78a6-4825-a819-b39255a8bc04 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102735) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:10:39.463730 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-691ff901-78a6-4825-a819-b39255a8bc04 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058785 May 17 18:10:39.463730 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 24/49] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 17 18:10:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 18:10:39.470145 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-4ea2cc65-f6bf-4f27-8821-41a2dbaabf89 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:39.484664 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-4ea2cc65-f6bf-4f27-8821-41a2dbaabf89 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018559 May 17 18:10:39.485130 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 26/50] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 17 18:10:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:10:39.494813 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:39.508134 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016839 May 17 18:10:39.508649 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 25/51] 10.222.0.65 () {60 vars in 1210 bytes} [Tue May 17 18:10:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:10:39.517768 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-0b871a4c-2b35-4af5-9b1e-b51c754d085f admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:39.523156 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.wsgi [None req-0b871a4c-2b35-4af5-9b1e-b51c754d085f admin admin] HTTP exception thrown: Flavor 451 could not be found. May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-0b871a4c-2b35-4af5-9b1e-b51c754d085f admin admin] Request method failure captured: May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Accept: application/json May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Accept-Encoding: gzip, deflate May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Connection: keep-alive May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Content-Length: 0 May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Host: 10.222.0.65 May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Openstack-Api-Version: compute 2.90 May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Openstack-System-Scope: None May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: User-Agent: python-novaclient May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Auth-Token: gAAAAABig-UfXGZ9OooStDmmzDMd_SZgmls9G0HeMMhO3GmCNxBdsrUpOYrMAfvednTtvEBrJobL-p3Ra4xX6BNolVluel8AVioszzsIBf2XBYZhRCMteY2_gbetoWEtjrApczs8mZXW5wgRx48Cb-Siy5470q8HLh3nsUu0j4J8MuITz8d6IAk May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Domain-Id: None May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Domain-Name: None May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Identity-Status: Confirmed May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Is-Admin-Project: True May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Openstack-Nova-Api-Version: 2.90 May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Domain-Id: default May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Domain-Name: Default May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Project-Name: admin May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Role: member,reader,admin May 17 18:10:39.524687 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Roles: member,reader,admin May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/22a045ecfd2045b79def0497d463b2a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Tenant: admin May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Tenant-Id: 22a045ecfd2045b79def0497d463b2a3 May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-Tenant-Name: admin May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User: admin May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Domain-Id: default May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Domain-Name: Default May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Id: 8763b2e915c44d8688900867e35dfda6 May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: X-User-Name: admin May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: method: > May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: exception: Flavor 451 could not be found. May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: action_args: {'id': '451'} May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:10:39.526193 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:39.527018 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: ERROR nova.api.openstack.wsgi May 17 18:10:39.528324 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-0b871a4c-2b35-4af5-9b1e-b51c754d085f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102734) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:10:39.529598 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-0b871a4c-2b35-4af5-9b1e-b51c754d085f admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011868 May 17 18:10:39.529598 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 27/52] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 17 18:10:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 17 18:10:40.410240 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:40.411235 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 May 17 18:10:40.411628 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 26/53] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:10:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:40.597875 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-fc892771-798b-448c-b27a-70d8f9d8d656 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:40.615079 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-fc892771-798b-448c-b27a-70d8f9d8d656 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.068890 May 17 18:10:40.615609 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 28/54] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 17 18:10:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:10:41.512355 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:41.513348 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 May 17 18:10:41.513787 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 27/55] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:10:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:41.707998 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-8a01dace-08c7-483d-b9f0-fe1783827068 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:41.725224 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-8a01dace-08c7-483d-b9f0-fe1783827068 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068122 May 17 18:10:41.725729 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 29/56] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 17 18:10:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:10:42.609846 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:42.611672 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002060 May 17 18:10:42.612231 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 28/57] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:10:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:42.797528 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-56acf561-13a3-44fe-a06e-2ff82cadcc4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:42.815071 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-56acf561-13a3-44fe-a06e-2ff82cadcc4a admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.067200 May 17 18:10:42.815611 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 30/58] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 17 18:10:42 2022] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:10:43.696450 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:43.697479 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 May 17 18:10:43.697882 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 29/59] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:10:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:43.884806 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-711313e0-48b6-4157-9311-1e81190a61d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:10:43.902160 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-711313e0-48b6-4157-9311-1e81190a61d1 admin admin] 10.222.0.65 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.066910 May 17 18:10:43.902707 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 31/60] 10.222.0.65 () {64 vars in 1235 bytes} [Tue May 17 18:10:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:10:44.791833 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:44.792846 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 17 18:10:44.793242 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 30/61] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:10:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:10:44.985912 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-cf6153c1-f6fb-4a42-a726-6a789eb60dd5 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:10:45.004591 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-cf6153c1-f6fb-4a42-a726-6a789eb60dd5 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074458 May 17 18:10:45.005070 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 32/62] 10.222.0.65 () {60 vars in 1202 bytes} [Tue May 17 18:10:44 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:11:46.825847 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:11:46.826837 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-ba3fc22c-79db-4a1d-9b67-9b487285b469 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 17 18:11:46.827229 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 31/63] 10.222.0.65 () {54 vars in 930 bytes} [Tue May 17 18:11:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:11:46.884079 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-4f88f319-2aa9-4cee-aa09-d9690c1d049c admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:11:46.903830 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-4f88f319-2aa9-4cee-aa09-d9690c1d049c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.070084 May 17 18:11:46.904313 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 33/64] 10.222.0.65 () {60 vars in 1291 bytes} [Tue May 17 18:11:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:11:46.926859 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-2c671013-9423-4055-8897-247430b7368c admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:11:46.934874 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-2c671013-9423-4055-8897-247430b7368c admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012617 May 17 18:11:46.935396 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 32/65] 10.222.0.65 () {60 vars in 1282 bytes} [Tue May 17 18:11:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:11:46.947330 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-ad13de72-940b-4d45-8db5-238e65a3079b admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:11:46.955551 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-ad13de72-940b-4d45-8db5-238e65a3079b admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012115 May 17 18:11:46.956074 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 34/66] 10.222.0.65 () {60 vars in 1285 bytes} [Tue May 17 18:11:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:11:46.966987 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-d73a03ce-4960-46f8-a61f-3ea46114af28 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:11:46.974405 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-d73a03ce-4960-46f8-a61f-3ea46114af28 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010936 May 17 18:11:46.974919 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 33/67] 10.222.0.65 () {60 vars in 1285 bytes} [Tue May 17 18:11:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:11:46.985899 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-d2922411-c70e-44fe-add5-34cc6a5d1007 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:11:46.993205 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-d2922411-c70e-44fe-add5-34cc6a5d1007 admin admin] 10.222.0.65 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010837 May 17 18:11:46.993764 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 35/68] 10.222.0.65 () {60 vars in 1282 bytes} [Tue May 17 18:11:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:15:27.887081 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-d73a03ce-4960-46f8-a61f-3ea46114af28 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:27.888078 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-d73a03ce-4960-46f8-a61f-3ea46114af28 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 17 18:15:27.888465 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 34/69] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:15:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:28.170315 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-fcdeb774-e7a9-4687-9e50-c98c3d1ddc92 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:28.171509 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:15:28.171509 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: warnings.warn(msg) May 17 18:15:28.172724 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-fcdeb774-e7a9-4687-9e50-c98c3d1ddc92 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:28.173155 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-fcdeb774-e7a9-4687-9e50-c98c3d1ddc92 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:28.174000 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-fcdeb774-e7a9-4687-9e50-c98c3d1ddc92 admin admin] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:28.174423 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-fcdeb774-e7a9-4687-9e50-c98c3d1ddc92 admin admin] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:28.208775 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-fcdeb774-e7a9-4687-9e50-c98c3d1ddc92 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.157811 May 17 18:15:28.209339 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 36/70] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 17 18:15:28 2022] GET /compute/v2.1/os-services => generated 791 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:15:29.132825 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-d73a03ce-4960-46f8-a61f-3ea46114af28 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:29.133870 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-d73a03ce-4960-46f8-a61f-3ea46114af28 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 17 18:15:29.134572 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 35/71] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:15:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:29.323753 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-3b6d8f4a-8719-473c-bf7b-39cc8c183eb1 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:29.324921 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:15:29.324921 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: warnings.warn(msg) May 17 18:15:29.326160 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-3b6d8f4a-8719-473c-bf7b-39cc8c183eb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:29.326746 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-3b6d8f4a-8719-473c-bf7b-39cc8c183eb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:29.328238 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-3b6d8f4a-8719-473c-bf7b-39cc8c183eb1 admin admin] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:29.328865 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-3b6d8f4a-8719-473c-bf7b-39cc8c183eb1 admin admin] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:29.349570 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-3b6d8f4a-8719-473c-bf7b-39cc8c183eb1 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078096 May 17 18:15:29.350063 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 37/72] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 17 18:15:29 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:15:40.687505 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-d73a03ce-4960-46f8-a61f-3ea46114af28 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:40.688527 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-d73a03ce-4960-46f8-a61f-3ea46114af28 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 17 18:15:40.688921 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 36/73] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:15:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:40.877230 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-94bd7b81-6ccc-4c8e-8e9d-52672048896e admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:40.878424 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:15:40.878424 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: warnings.warn(msg) May 17 18:15:40.879619 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-94bd7b81-6ccc-4c8e-8e9d-52672048896e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:40.880085 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-94bd7b81-6ccc-4c8e-8e9d-52672048896e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:40.880859 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-94bd7b81-6ccc-4c8e-8e9d-52672048896e admin admin] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:40.881281 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-94bd7b81-6ccc-4c8e-8e9d-52672048896e admin admin] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:40.906237 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-94bd7b81-6ccc-4c8e-8e9d-52672048896e admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081472 May 17 18:15:40.906722 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 38/74] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 17 18:15:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:15:41.815464 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: DEBUG nova.api.openstack.wsgi [None req-d73a03ce-4960-46f8-a61f-3ea46114af28 admin admin] Calling method '>' {{(pid=102735) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:41.816460 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: INFO nova.api.openstack.requestlog [None req-d73a03ce-4960-46f8-a61f-3ea46114af28 admin admin] 10.222.0.65 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001401 May 17 18:15:41.816855 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: [pid: 102735|app: 0|req: 37/75] 10.222.0.65 () {56 vars in 1074 bytes} [Tue May 17 18:15:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:15:42.006316 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG nova.api.openstack.wsgi [None req-0cc9bc70-5c5a-4c95-907e-e34c2c770b33 admin admin] Calling method '>' {{(pid=102734) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:15:42.007473 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:15:42.007473 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: warnings.warn(msg) May 17 18:15:42.008638 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-0cc9bc70-5c5a-4c95-907e-e34c2c770b33 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.009069 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-0cc9bc70-5c5a-4c95-907e-e34c2c770b33 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:42.009899 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-0cc9bc70-5c5a-4c95-907e-e34c2c770b33 admin admin] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:15:42.010321 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: DEBUG oslo_concurrency.lockutils [None req-0cc9bc70-5c5a-4c95-907e-e34c2c770b33 admin admin] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102734) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:15:42.032309 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: INFO nova.api.openstack.requestlog [None req-0cc9bc70-5c5a-4c95-907e-e34c2c770b33 admin admin] 10.222.0.65 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.076892 May 17 18:15:42.032784 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: [pid: 102734|app: 0|req: 39/76] 10.222.0.65 () {60 vars in 1193 bytes} [Tue May 17 18:15:41 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:16:38.372400 dv-cinder-837362-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 17 18:16:38.373144 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: Tue May 17 18:16:38 2022 - graceful shutdown triggered... May 17 18:16:38.373699 dv-cinder-837362-2-iscsi devstack@n-api.service[102735]: Gracefully killing worker 2 (pid: 102735)... May 17 18:16:38.374083 dv-cinder-837362-2-iscsi devstack@n-api.service[102734]: Gracefully killing worker 1 (pid: 102734)... May 17 18:16:39.374120 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: worker 1 buried after 1 seconds May 17 18:16:39.374120 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: worker 2 buried after 1 seconds May 17 18:16:39.374120 dv-cinder-837362-2-iscsi devstack@n-api.service[102733]: goodbye to uWSGI. May 17 18:16:39.375676 dv-cinder-837362-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 17 18:16:39.376244 dv-cinder-837362-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 17 18:16:39.379032 dv-cinder-837362-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 17 18:16:39.394875 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 17 18:16:39.408009 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 18:16:39 2022] *** May 17 18:16:39.408009 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 18:16:39.408009 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 18:16:39.408009 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: nodename: dv-cinder-837362-2-iscsi May 17 18:16:39.408009 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: machine: x86_64 May 17 18:16:39.408009 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: clock source: unix May 17 18:16:39.408009 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: pcre jit disabled May 17 18:16:39.408009 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: detected number of CPU cores: 4 May 17 18:16:39.408009 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: current working directory: / May 17 18:16:39.408009 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: detected binary path: /usr/bin/uwsgi-core May 17 18:16:39.408826 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: your processes number limit is 47680 May 17 18:16:39.408826 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: your memory page size is 4096 bytes May 17 18:16:39.408826 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: detected max file descriptor number: 2048 May 17 18:16:39.408826 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: lock engine: pthread robust mutexes May 17 18:16:39.408826 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: thunder lock: enabled May 17 18:16:39.408826 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 17 18:16:39.408826 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 18:16:39.454567 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: Python main interpreter initialized at 0x55f30d2ac9c0 May 17 18:16:39.454567 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: python threads support enabled May 17 18:16:39.454567 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: your server socket listen backlog is limited to 100 connections May 17 18:16:39.454567 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: your mercy for graceful operations on workers is 90 seconds May 17 18:16:39.455005 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: mapped 403077 bytes (393 KB) for 2 cores May 17 18:16:39.455005 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: *** Operational MODE: preforking *** May 17 18:16:39.455257 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: *** uWSGI is running in multiple interpreter mode *** May 17 18:16:39.455257 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: spawned uWSGI master process (pid: 117077) May 17 18:16:39.455466 dv-cinder-837362-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 17 18:16:39.456108 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: spawned uWSGI worker 1 (pid: 117098, cores: 1) May 17 18:16:39.456476 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: spawned uWSGI worker 2 (pid: 117099, cores: 1) May 17 18:16:39.457591 dv-cinder-837362-2-iscsi devstack@n-api.service[117077]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 18:16:40.662136 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 18:16:40.662790 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 17 18:16:41.461198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:16:41.461198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: from cryptography.utils import int_from_bytes May 17 18:16:41.461634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:16:41.461634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: from cryptography.utils import int_from_bytes May 17 18:16:41.463470 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:16:41.463470 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: from cryptography.utils import int_from_bytes May 17 18:16:41.463795 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 18:16:41.463795 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: from cryptography.utils import int_from_bytes May 17 18:16:43.889436 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 18:16:43.890018 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 18:16:43.890262 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 18:16:43.890637 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 18:16:43.890901 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 18:16:43.891298 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.891632 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.891961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.892287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.892624 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.892942 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.893271 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.893620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.893961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.894230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.894552 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.894889 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837362-2-iscsi {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.900023 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.900360 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.900711 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.901228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.901667 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.901942 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.902273 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.902826 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.904241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.904241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.904459 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.904678 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.904972 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.905280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.905642 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.905966 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.906307 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.906629 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.907048 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837362-2-iscsi {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.907378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.907702 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.908028 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.908460 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.908779 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.909099 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.909431 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.909782 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.910105 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.910436 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.910770 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.911094 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.911426 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.911740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.912081 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.912375 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.912893 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.913004 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.913311 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.913595 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.913913 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.914324 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.914758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.914939 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.915154 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.915411 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.915754 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.916064 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.916378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.916693 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.917007 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.917322 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.917663 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.917977 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.918858 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.919204 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.919532 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.919859 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.920190 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.920507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.920834 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.921246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.921527 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.921847 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.922196 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.922524 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.922840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.923166 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.923492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.923815 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.924128 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.924442 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.924771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.925102 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.925415 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.925699 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.926010 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.926324 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.926651 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.926966 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.927279 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.927592 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.927899 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.928213 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.928527 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.928841 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.929157 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.929492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.929803 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.930120 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.930436 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.930751 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.931081 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.931409 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.931724 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.932038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.932353 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.932667 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.932995 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.933094 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 18:16:43.933526 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.933625 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 18:16:43.933726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.933860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 18:16:43.934620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.934806 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 18:16:43.934925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.935073 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 18:16:43.935243 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.935472 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.935573 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.935808 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.935910 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.936139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.936233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.936470 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.936570 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.936780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.936885 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.937096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.937189 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.937421 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.937557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.937764 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.937941 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.938097 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.938241 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.938376 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.938525 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.938681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.938843 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.938983 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.942447 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-837362-2-iscsi {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.942587 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.942670 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.942751 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.942751 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.942893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.942971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.943049 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.943126 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.943277 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.944586 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.944676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.944768 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.944859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.944942 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.945034 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.945117 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.945199 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.945302 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.945393 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.945508 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.945612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.945704 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.945794 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.945877 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.945968 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.946060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.946153 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.946245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.946335 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.946427 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.946510 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.946603 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.946692 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.946780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.946869 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.946952 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.947033 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.947127 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.947210 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-837362-2-iscsi {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.947428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.947428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.947428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.947428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.948008 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.948099 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.948182 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.948264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.948355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.948445 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.948540 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.948624 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.948705 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.948788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.948882 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.948966 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.949057 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.949146 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.949345 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.949445 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.949731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.949848 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.950054 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.950240 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.950403 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.950729 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.950833 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.951064 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.951163 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.951397 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.951487 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.951713 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.951813 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.952030 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.952119 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.952347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.952443 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.952663 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.952754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.952980 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.953078 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.953296 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.953388 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.953583 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.953693 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.953905 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.953997 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.954240 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.954344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.954573 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.954662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.954894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.954985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.955153 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.955257 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.955414 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.955505 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.955742 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.955834 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.956074 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.956174 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.956395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.956486 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.956712 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.956813 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.957029 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.957121 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.957347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.957491 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.957693 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.957797 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.958007 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.958097 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.958319 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.958415 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.958628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.958724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.958940 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.959033 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.959258 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.959349 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.959570 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.959670 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.959890 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.959990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.960221 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.960320 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.960529 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.960628 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.65 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.960868 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.960959 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.65 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.961180 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.961274 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.961516 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.961628 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.961836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.961936 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.962150 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.962250 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.962463 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.962572 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.962782 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.962891 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.963098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.963196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.963407 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.963512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.963744 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.963842 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.964062 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.964156 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.964374 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.964475 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.964696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.964795 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.964959 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.965050 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.965300 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.965401 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.965654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.965752 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.965974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.966066 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.966291 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.966382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.966607 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.966705 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.966919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.967016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.967229 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.967336 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.967547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.967646 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.967868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.967981 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.968182 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.968337 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.968500 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.968592 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.968817 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.968923 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.969131 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.969232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.969449 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.969654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.969790 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.969881 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.970101 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.970200 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.970417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.970517 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.970730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.970829 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.971041 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.971140 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.971351 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.971448 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.971663 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.971754 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.971971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.972068 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.972281 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.972385 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.972593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.972692 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.972903 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.972994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.973212 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.973316 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.973550 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.973646 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.973868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.973961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.974179 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.974277 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.974489 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.974586 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.974799 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.974901 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.975124 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.975216 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.975436 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.975535 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.975754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.975846 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.976078 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.976171 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.976394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.976492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.976708 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.976799 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.977020 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.977112 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.977333 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.977425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.977685 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.977778 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.978003 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.978114 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.978314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.978404 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.978625 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.978727 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.978935 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.979034 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.979253 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.979356 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.979580 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.979679 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.979897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.979987 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.980212 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.980311 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.980526 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.980624 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.981374 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.981532 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 18:16:43.981712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.981816 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.982036 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.982183 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.982383 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.982482 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.982724 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.982815 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.983049 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.983142 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.983378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.983479 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.983702 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.983839 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.984021 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.984120 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.984342 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.984455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.984659 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.984760 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.984977 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.985079 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.985292 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.985385 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.985638 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.985748 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.985954 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.986046 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.986280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.986380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.986597 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.986704 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.986928 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.987030 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.987248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.987425 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.987587 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.987749 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.987894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.988048 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.988195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.988337 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.988477 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.988627 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.988812 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.988959 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.989130 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.989270 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.989449 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.989579 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.989796 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.989895 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.990113 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.990211 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.990430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.990532 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.990748 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.990851 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.991061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.991160 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.991374 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.991511 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.991692 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.991785 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.992010 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.992110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.992327 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.992433 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.992643 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.992736 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.992954 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.993044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.993273 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.993366 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.993610 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.993707 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.993923 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.994027 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.994237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.994409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.994547 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.994636 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.994869 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.994969 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.995186 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.995277 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.995514 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.995605 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.995844 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.995968 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.996156 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.996256 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.997048 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.997156 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.997372 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.997535 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.997715 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.997806 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.998028 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.998118 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.998339 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.998434 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.998650 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.998749 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.998967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.999057 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.999283 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.999383 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.999600 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.999697 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:43.999923 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.000015 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.000237 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.000328 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.000554 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.000646 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.000873 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.000972 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.001191 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.001283 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.001528 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.001639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.001847 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.001959 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.002164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.002262 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.002475 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.002575 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.002791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.002890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.003104 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.003202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.003419 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.003510 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.003737 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.003839 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.004051 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.004142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.004386 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.004520 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.004703 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.004804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.005016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.005105 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.005326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.005424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.005666 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.005768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.005984 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.006078 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.006305 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.006564 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.006668 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.006902 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.007003 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.007226 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.007316 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.007550 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.007650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.007875 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.007967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.008202 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.008336 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.008514 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.008613 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.008851 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.008943 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.009185 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.009275 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.009514 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.009621 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.009835 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.009926 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.010148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.010239 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.010460 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.010593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.010775 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.010867 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.011083 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.011173 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.011395 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.011486 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.011704 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.011807 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.012034 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.012136 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.012705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.012827 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.012963 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.013066 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.013152 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.013234 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.013396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.013515 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.013764 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.013864 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.014078 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.014178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.014403 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.014505 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.014715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.014821 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.015045 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.015152 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.015361 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.015461 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.015674 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.015766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.015986 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.016077 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.016296 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.016388 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.016646 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.016740 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.016956 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.017054 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.017302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.017393 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.017652 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.017756 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.017979 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.018078 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.018300 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.018436 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.018610 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.018701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.018939 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.019030 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.019251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.019351 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.019563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.019654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.019875 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.020000 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.020192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.020320 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.020507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.020632 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.020817 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.020949 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.021135 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.021271 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.023270 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.023412 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.023542 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.023656 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.023773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.023899 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.024012 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.024120 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.024236 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.024358 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.024469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.024609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.024738 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.024865 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.024999 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.025128 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.025264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.025398 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.025543 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.025683 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.025812 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.025937 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.026077 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.026212 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.026340 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.026472 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.026607 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.026733 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.026868 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.027002 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.027130 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.027256 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.027382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.027515 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.028230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.028372 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.028506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.028632 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.028766 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.028906 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.029041 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.029167 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.029307 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.029307 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.029591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.029759 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.029897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.030025 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.030158 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.030294 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.030428 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.030564 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.030698 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.030831 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.030957 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.031090 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.031239 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.031371 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.031481 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.031590 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.031704 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.031845 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.031986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.032120 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.032255 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.032374 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.032481 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.032608 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.032748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.032876 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.033009 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.033143 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.033284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.033507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.033655 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.033794 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.033918 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.034053 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.034279 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.034418 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.034537 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.034697 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.034890 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.035066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.035161 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.035339 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.035437 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.035437 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.035633 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.035724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.035879 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.036036 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.036269 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.036405 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.036576 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.036689 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.036957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.037065 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.037269 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.037424 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.037647 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.037773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.037949 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.038083 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.038269 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.038400 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.038582 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.038714 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.038908 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.039040 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.039237 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.039368 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.039586 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.039722 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.039935 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.040094 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.040262 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.040391 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.040526 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.040654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.040816 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.041004 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.041193 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.041291 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.041476 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.041593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.041768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.041932 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.042136 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.042248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.042404 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.042560 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.042723 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.042894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.043042 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.043225 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.043909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.044126 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.044223 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.044393 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.044513 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.044712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.044847 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.045032 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.045127 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.045354 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.045452 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.045695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.046013 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.046114 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.046330 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.046421 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.046650 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.046748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.046970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.047063 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.047287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.047460 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.047607 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.047702 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.047921 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.048021 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.048238 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.048337 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.048555 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.048654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.048868 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.048972 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.049202 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.049321 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.049545 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.049677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.049863 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.050003 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.050185 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.050338 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.050620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.050800 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.050942 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.051119 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.051240 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.051440 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.051683 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.051783 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.052004 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.052095 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.052327 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.052445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.052638 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.052740 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.052957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.053049 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.053277 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.053370 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.053617 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.053715 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.053940 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.054034 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.054256 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.054342 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.054578 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.054679 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.054898 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.054990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.055214 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.055309 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.055528 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.055624 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.055848 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.055947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.056201 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.056301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.056517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.056615 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.056852 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.056953 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.057165 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.057259 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.057490 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.057646 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.057807 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.057912 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.058137 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.058237 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.058452 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.058551 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.058779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.058975 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.059125 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.059225 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.059442 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.059539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.059762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.059864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.060082 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.060228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.060397 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.060546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.060719 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.060864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.061039 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.061194 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.061360 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.061544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.061711 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.061876 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.062025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.062190 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.062371 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.062511 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.062653 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.062827 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.062977 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.063161 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.063311 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.063493 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.063610 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.063811 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.063915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.064150 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.064265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.065479 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.065611 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.065727 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.065822 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.065920 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.066007 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.066111 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.066198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.066198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.066198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.066432 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.066645 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.066880 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.067033 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.067270 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.067413 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.067584 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.067746 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.067920 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.068070 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.068243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.068391 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.068558 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.068712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.068871 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.069012 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.069190 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.069324 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.069533 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.069688 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.069844 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.069981 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.070156 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.070297 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.070488 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.070641 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.070804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.070944 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.071118 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.071259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.071435 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.071582 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.071748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.071897 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.072059 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.072198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.072373 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.072816 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.072966 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.073108 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.073247 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.073382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.073581 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.073726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.073898 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.074046 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.074212 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.074456 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.074622 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.074760 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.074915 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.075054 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.075193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.075337 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.075501 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.075602 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.075815 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.075927 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.076125 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.076225 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.076435 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.076534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.076778 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.076873 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.077088 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.077186 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.077418 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.077543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.077784 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.077882 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.078113 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.078214 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.078431 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.078521 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.078749 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.078839 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.079075 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.079215 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.079390 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.079483 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.079713 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.079810 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.080030 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.080122 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.080345 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.080435 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.080657 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.080754 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.080970 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.081063 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.081278 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.081374 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.081619 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.081715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.081933 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.082026 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.082250 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.082351 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.082562 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.082662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.082873 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.083017 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.083184 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.083275 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.083501 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.083599 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.083826 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.083923 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.084171 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.084269 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.084507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.084610 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.084754 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.084847 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.085065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.085166 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.085381 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.085493 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.085745 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.085866 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.086054 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.086157 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.086376 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.086467 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.086693 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.086785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.087013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.087114 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.087333 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.087427 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.087646 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.087744 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.087983 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.088126 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.088299 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.088404 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.088615 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.088742 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.088917 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.089008 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.089235 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.089341 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.089581 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.089702 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.089899 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.090030 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.090872 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.090976 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.091190 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.091510 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.091612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.091827 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.091920 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.092147 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.092237 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.092466 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.092705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.092803 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.093042 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.093149 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.093365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.093488 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.093709 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.093850 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.094028 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.094173 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.094353 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.094495 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.094682 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.094831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.095003 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.095117 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.095327 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.095447 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.095645 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.095753 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.095966 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.096098 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.096303 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.096396 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.096634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.096733 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.096943 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.097048 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.097277 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.097377 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.097617 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.097717 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.097940 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.098048 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.098266 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.098357 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.098589 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.098680 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.098955 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.099061 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.099277 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.099412 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.099592 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.099717 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.099913 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.100013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.100238 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.100328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.100561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.100653 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.100882 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.100975 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.101200 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.101300 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.101557 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.101653 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.101877 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.101976 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.102192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.102291 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.102510 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.102612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.102832 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.102924 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.103153 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.103251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.103467 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.103570 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.103801 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.103893 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.104132 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.104231 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.104455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.104556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.104779 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.104907 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.105102 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.105227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.105541 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.105695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.108217 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.108330 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.108417 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.108508 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.108602 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.108692 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.108776 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.108866 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.108950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.109032 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.109164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.109265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.109375 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.109538 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.109638 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.109723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.109815 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.109906 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.109990 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.110079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.110162 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.110253 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.110338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.110428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.110518 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.110601 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.110691 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.110787 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.110871 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.110954 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.111081 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.111250 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.111394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.111567 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.111727 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.112053 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.112152 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.112384 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.112476 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.112714 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.112814 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.113030 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.113182 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.113361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.113517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.113706 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.113814 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.114020 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.114112 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.114339 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.114480 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.114652 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.114756 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.114964 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.115085 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.115287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.115401 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.115607 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.115699 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.115918 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.116018 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.116231 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.116336 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.116547 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.116675 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.116867 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.116985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.117176 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.117292 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.117511 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.117614 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.117824 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.117917 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.118158 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.118254 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.118471 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.118566 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.118783 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.118877 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.119097 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.119260 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.119404 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.119544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.119704 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.119840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.120059 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.120203 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.120351 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.120498 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.120636 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.120784 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.120929 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.121067 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.121213 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.121376 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.121553 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.121699 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.121840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.121979 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.122156 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.122306 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.122470 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.122617 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.122788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.122929 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.123154 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.123294 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.123484 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.123589 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.123797 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.124041 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.124132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.124417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.124606 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.124733 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.125065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.125219 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.125393 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.125710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.125830 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.126074 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.126274 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.126392 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.126904 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.127022 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.127255 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.127460 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.127758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.127871 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.128151 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.128355 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.128494 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.128703 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.128837 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.129024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.129208 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.129526 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.129652 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.129897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.130091 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.130232 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.130560 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.130694 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.130893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.131053 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.131226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.131378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.131557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.131702 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.132027 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.132117 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.132349 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.132448 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.132669 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.132771 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.132990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.133082 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.133308 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.133404 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.133652 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.133749 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.133971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.134064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.134291 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.134386 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.134609 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.134701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.134963 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.135076 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.135287 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.135393 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.135632 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.135736 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.135951 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.136056 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.136276 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.136390 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.136597 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.136689 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.137027 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.137134 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.137277 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.137381 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.137620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.137727 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.137938 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.138030 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.138263 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.138365 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.138603 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.138696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.139002 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.139092 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.139368 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.139472 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.139699 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.139847 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.140027 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.140174 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.140470 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.140563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.140820 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.141045 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.141143 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.141475 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.141678 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.141810 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.142132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.142260 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.142459 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.142764 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.142857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.143107 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.143250 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.143450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.143581 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.143789 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.144055 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.144160 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.144422 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.144657 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.144767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.145022 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.145116 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.145342 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.145447 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.145691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.145797 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.146006 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.146107 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.146317 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.146418 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.146627 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.146883 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.147003 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.147216 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.147319 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.147535 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.147647 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.147844 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.147938 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.148155 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.148256 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.148470 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.148574 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.148776 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.148871 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.149085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.149186 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.149395 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.149534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.149730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.149838 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.150043 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.150148 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.150349 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.150453 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.150661 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.150763 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.150969 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.151070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.151277 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.151380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.151585 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.151678 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.151894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.152064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.152242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.152390 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.152523 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.153392 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.153733 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.153842 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.154065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.154170 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.154383 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.154541 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.154709 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.154804 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.155030 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.155132 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.155360 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.155465 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.155683 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.155848 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.155998 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.156090 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.156313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.156426 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.156628 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.156740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.156952 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.157052 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.157267 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.157520 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.157615 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.157714 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.157908 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.158009 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.158223 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.158317 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.158539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.158645 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.158852 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.158943 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.159173 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.159265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.159485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.159576 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.159814 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.159906 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.160129 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.160225 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.160446 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.160539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.160761 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.160852 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.161074 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.161170 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.161387 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.161498 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.161735 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.161840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.162048 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.162145 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.162361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.162452 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.162674 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.162763 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.162990 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.163089 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.163310 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.163448 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.163629 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.163740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.163952 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.164058 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.164267 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.164363 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.164581 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.164672 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.164918 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.165019 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.165252 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.165344 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.165590 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.165700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.165912 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.166025 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.166237 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.166329 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.166559 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.166673 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.166896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.167008 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.167210 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.167301 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.167525 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.167691 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.167848 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117098) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 18:16:44.167994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.168180 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.169282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.169658 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.169995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.170340 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.170686 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.171009 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.171362 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.171652 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.171987 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.172310 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.172631 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.172954 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.173277 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.173633 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.173958 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.174279 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.174603 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.174920 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.175239 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.175558 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.175878 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.176202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.176552 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.176947 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.177213 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.177562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.177893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.178214 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.178534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.178853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.179173 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.179498 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.179837 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.180163 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.180480 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.180915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.181240 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.181594 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.181926 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.182247 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.182580 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.182915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.183236 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.183568 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.184014 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.184366 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.184718 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.185058 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.185398 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.185750 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.186094 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.186606 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.186731 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.187148 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.187323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.187690 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.187949 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.188269 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.188583 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.188898 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.189215 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.189638 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.189966 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.190281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.190593 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.190904 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.191217 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.191532 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.191788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_db.sqlalchemy.engines [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:16:44.191895 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.192150 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.192465 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.192950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.193308 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.194199 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.194199 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.194853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.194853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.194853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.195346 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.195533 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.195923 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.196163 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.196579 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.196818 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.197091 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.197432 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.198064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.198362 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.198665 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.199135 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.199303 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.199680 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.199930 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.200293 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.200603 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.200923 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.201260 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.201612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.201947 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.202419 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.202597 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.202916 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.203238 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.203558 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.203884 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.204208 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.204524 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.204849 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.205176 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.205539 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.205876 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.206196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.206537 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.206863 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.207223 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.207553 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.207909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.208250 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.208578 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.208902 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.209215 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 18:16:44.209476 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117099) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 18:16:44.233485 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_db.sqlalchemy.engines [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:16:44.258431 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.context [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc8af911-08c4-433f-ae77-a63829b3d3e3(cell1) {{(pid=117098) load_cells /opt/stack/nova/nova/context.py:464}} May 17 18:16:44.262849 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:44.264437 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:44.265263 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:44.267235 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:44.278978 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_db.sqlalchemy.engines [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:16:44.280290 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_db.sqlalchemy.engines [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:16:44.297486 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.context [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),fc8af911-08c4-433f-ae77-a63829b3d3e3(cell1) {{(pid=117099) load_cells /opt/stack/nova/nova/context.py:464}} May 17 18:16:44.301897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:44.303533 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:44.304358 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:16:44.306350 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:16:44.318384 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_db.sqlalchemy.engines [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:16:44.319269 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_db.sqlalchemy.engines [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:16:44.443656 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_db.sqlalchemy.engines [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117098) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:16:44.484905 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_db.sqlalchemy.engines [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117099) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 18:16:44.764507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: WARNING keystonemiddleware.auth_token [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:16:44.772001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: WARNING keystonemiddleware.auth_token [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:16:44.809424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: WARNING keystonemiddleware.auth_token [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:16:44.817450 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: WARNING keystonemiddleware.auth_token [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:16:45.120897 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: WARNING keystonemiddleware.auth_token [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:16:45.127703 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: WARNING keystonemiddleware.auth_token [None req-9e30bce6-c1c6-4b33-87f7-8ec92ca9ef2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:16:45.133085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f30d2ac9c0 pid: 117098 (default app) May 17 18:16:45.180077 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: WARNING keystonemiddleware.auth_token [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 17 18:16:45.186945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: WARNING keystonemiddleware.auth_token [None req-e944563f-5c2d-41c3-85c5-acfa42b13aad None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 17 18:16:45.192672 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f30d2ac9c0 pid: 117099 (default app) May 17 18:17:27.432805 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8fd36032-d2cc-40cd-98e2-0ea9e2112ce2 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Action: 'create', calling method: .version_select at 0x7f4e61429280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1003024087", "metadata": {"Type": "work"}}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8fd36032-d2cc-40cd-98e2-0ea9e2112ce2 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Request method failure captured: May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 122 May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-a2CxCik2a-l-vHZvP_-z2SRMDSvMuzmrpgQ5LwI7aZ4ELp6dRZwUSSbqDWD5I8ADCsmKMuJAa-WIcXBeO0Zcmu19hdCDWVdosYrXkuLCk_75kmXP4-LnZq_EP5uIvGxjRAjPgK3GBemeKmOpQdc9sAwk3qdxHs_Cw6pzu-OC32G20 May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:17:27.452141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-VolumesNegativeTest-724601828 May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-VolumesNegativeTest-724601828-project May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 82a34231bf8e43808d6cb1cb55d93060 May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-VolumesNegativeTest-724601828-project May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1003024087", "metadata": {"Type": "work"}}} May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: May 17 18:17:27.454346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1003024087', 'metadata': {'Type': 'work'}}}} May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise error May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi '#$%' May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:17:27.455193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 18:17:27.456517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 18:17:27.457823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 17 18:17:27.457823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:27.457823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8fd36032-d2cc-40cd-98e2-0ea9e2112ce2 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:17:27.457823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8fd36032-d2cc-40cd-98e2-0ea9e2112ce2 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.093541 May 17 18:17:27.457823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 1/1] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 17 18:17:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1096 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 18:17:28.055135 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-86545eb1-2b57-4ef3-925d-3c6a195709b0 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Action: 'create', calling method: .version_select at 0x7f4e61453ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-676910744", "metadata": {"Type": "work"}}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-86545eb1-2b57-4ef3-925d-3c6a195709b0 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Request method failure captured: May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 119 May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-a2CxCik2a-l-vHZvP_-z2SRMDSvMuzmrpgQ5LwI7aZ4ELp6dRZwUSSbqDWD5I8ADCsmKMuJAa-WIcXBeO0Zcmu19hdCDWVdosYrXkuLCk_75kmXP4-LnZq_EP5uIvGxjRAjPgK3GBemeKmOpQdc9sAwk3qdxHs_Cw6pzu-OC32G20 May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:17:28.063696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-VolumesNegativeTest-724601828 May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-VolumesNegativeTest-724601828-project May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 82a34231bf8e43808d6cb1cb55d93060 May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-VolumesNegativeTest-724601828-project May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-676910744", "metadata": {"Type": "work"}}} May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: May 17 18:17:28.065361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-676910744', 'metadata': {'Type': 'work'}}}} May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise error May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi '0' May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:17:28.066197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 18:17:28.067464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 18:17:28.068723 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 17 18:17:28.068723 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.074362 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-86545eb1-2b57-4ef3-925d-3c6a195709b0 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:17:28.076652 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-86545eb1-2b57-4ef3-925d-3c6a195709b0 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.608699 May 17 18:17:28.077882 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 1/2] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 17 18:17:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 618 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 18:17:28.087864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-79c57acf-a05f-4ccf-8f6e-021c71475398 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Action: 'create', calling method: .version_select at 0x7f4e612be5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1081313830", "metadata": {"Type": "work"}}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-79c57acf-a05f-4ccf-8f6e-021c71475398 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Request method failure captured: May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 119 May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-a2CxCik2a-l-vHZvP_-z2SRMDSvMuzmrpgQ5LwI7aZ4ELp6dRZwUSSbqDWD5I8ADCsmKMuJAa-WIcXBeO0Zcmu19hdCDWVdosYrXkuLCk_75kmXP4-LnZq_EP5uIvGxjRAjPgK3GBemeKmOpQdc9sAwk3qdxHs_Cw6pzu-OC32G20 May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:17:28.091287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-VolumesNegativeTest-724601828 May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-VolumesNegativeTest-724601828-project May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 82a34231bf8e43808d6cb1cb55d93060 May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-VolumesNegativeTest-724601828-project May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1081313830", "metadata": {"Type": "work"}}} May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: May 17 18:17:28.092612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1081313830', 'metadata': {'Type': 'work'}}}} May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise error May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi On instance['volume']: May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi '' May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:17:28.093379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 17 18:17:28.095686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 17 18:17:28.096917 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 17 18:17:28.096917 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:28.096917 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-79c57acf-a05f-4ccf-8f6e-021c71475398 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:17:28.097137 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-79c57acf-a05f-4ccf-8f6e-021c71475398 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010884 May 17 18:17:28.098088 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 2/3] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 17 18:17:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 18:17:28.114471 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-fb5408fe-480c-4079-b604-c69d0908d44e tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Calling method '.version_select at 0x7f4e61311280>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:28.710201 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-fb5408fe-480c-4079-b604-c69d0908d44e tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] HTTP exception thrown: Volume tempest-invalid-1917485863 could not be found. May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-fb5408fe-480c-4079-b604-c69d0908d44e tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Request method failure captured: May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1917485863 HTTP/1.1 May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-a2CxCik2a-l-vHZvP_-z2SRMDSvMuzmrpgQ5LwI7aZ4ELp6dRZwUSSbqDWD5I8ADCsmKMuJAa-WIcXBeO0Zcmu19hdCDWVdosYrXkuLCk_75kmXP4-LnZq_EP5uIvGxjRAjPgK3GBemeKmOpQdc9sAwk3qdxHs_Cw6pzu-OC32G20 May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:17:28.721226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-VolumesNegativeTest-724601828 May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-VolumesNegativeTest-724601828-project May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 82a34231bf8e43808d6cb1cb55d93060 May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-VolumesNegativeTest-724601828-project May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Volume tempest-invalid-1917485863 could not be found. May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': 'tempest-invalid-1917485863'} May 17 18:17:28.722557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1917485863 could not be found. (HTTP 404) (Request-ID: req-32500724-f3f7-4a51-9355-86c78382f100) May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:28.723748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:17:28.725076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1917485863 could not be found. May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:17:28.726264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1917485863 could not be found. May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1917485863 could not be found. May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-fb5408fe-480c-4079-b604-c69d0908d44e tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Returning 404 to user: Volume tempest-invalid-1917485863 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-fb5408fe-480c-4079-b604-c69d0908d44e tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1917485863" status: 404 len: 99 microversion: 2.1 time: 0.619775 May 17 18:17:28.727455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 2/4] 10.222.0.65 () {58 vars in 1217 bytes} [Tue May 17 18:17:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1917485863 => generated 99 bytes in 622 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 17 18:17:28.738317 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a90c9035-5399-42ec-a699-9cdd784d51af tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006532 May 17 18:17:28.738925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 3/5] 10.222.0.65 () {58 vars in 1139 bytes} [Tue May 17 18:17:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 17 18:17:28.748747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-19a5d2a8-999e-4266-b256-6aeee06087f8 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004187 May 17 18:17:28.754422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 3/6] 10.222.0.65 () {58 vars in 1136 bytes} [Tue May 17 18:17:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 17 18:17:28.767386 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0c0a6171-1784-44e8-ad31-87ee9bfd31af tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Calling method '.version_select at 0x7f4e61db8430>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:29.032952 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-0c0a6171-1784-44e8-ad31-87ee9bfd31af tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] HTTP exception thrown: Volume 533cb2f2-c13c-484e-8772-a79863d1fa7c could not be found. May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0c0a6171-1784-44e8-ad31-87ee9bfd31af tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Request method failure captured: May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: DELETE /compute/v2.1/os-volumes/533cb2f2-c13c-484e-8772-a79863d1fa7c HTTP/1.1 May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-a2CxCik2a-l-vHZvP_-z2SRMDSvMuzmrpgQ5LwI7aZ4ELp6dRZwUSSbqDWD5I8ADCsmKMuJAa-WIcXBeO0Zcmu19hdCDWVdosYrXkuLCk_75kmXP4-LnZq_EP5uIvGxjRAjPgK3GBemeKmOpQdc9sAwk3qdxHs_Cw6pzu-OC32G20 May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:17:29.039246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-VolumesNegativeTest-724601828 May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-VolumesNegativeTest-724601828-project May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 82a34231bf8e43808d6cb1cb55d93060 May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-VolumesNegativeTest-724601828-project May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Volume 533cb2f2-c13c-484e-8772-a79863d1fa7c could not be found. May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '533cb2f2-c13c-484e-8772-a79863d1fa7c'} May 17 18:17:29.040785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 533cb2f2-c13c-484e-8772-a79863d1fa7c could not be found. (HTTP 404) (Request-ID: req-b5c9f73a-9da4-4366-bc0b-d548bb19d0d6) May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:29.041745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:17:29.043098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 533cb2f2-c13c-484e-8772-a79863d1fa7c could not be found. May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 18:17:29.045096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:17:29.047233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 533cb2f2-c13c-484e-8772-a79863d1fa7c could not be found. May 17 18:17:29.047233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:29.047233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:29.047233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:29.047233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:29.047233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:29.047233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:29.047233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:17:29.047233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:17:29.047233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 533cb2f2-c13c-484e-8772-a79863d1fa7c could not be found. May 17 18:17:29.047233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:17:29.050659 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0c0a6171-1784-44e8-ad31-87ee9bfd31af tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Returning 404 to user: Volume 533cb2f2-c13c-484e-8772-a79863d1fa7c could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:17:29.051699 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0c0a6171-1784-44e8-ad31-87ee9bfd31af tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/533cb2f2-c13c-484e-8772-a79863d1fa7c" status: 404 len: 109 microversion: 2.1 time: 0.291034 May 17 18:17:29.052368 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 4/7] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 17 18:17:28 2022] DELETE /compute/v2.1/os-volumes/533cb2f2-c13c-484e-8772-a79863d1fa7c => generated 109 bytes in 292 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:17:29.063536 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1c141cd3-a5e6-4604-a0c8-50a599b6aeb9 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Calling method '.version_select at 0x7f4e6125aee0>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:29.455265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-1c141cd3-a5e6-4604-a0c8-50a599b6aeb9 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] HTTP exception thrown: Volume 4a702836-c26d-4c95-9880-3f95055dc105 could not be found. May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1c141cd3-a5e6-4604-a0c8-50a599b6aeb9 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Request method failure captured: May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/os-volumes/4a702836-c26d-4c95-9880-3f95055dc105 HTTP/1.1 May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-a2CxCik2a-l-vHZvP_-z2SRMDSvMuzmrpgQ5LwI7aZ4ELp6dRZwUSSbqDWD5I8ADCsmKMuJAa-WIcXBeO0Zcmu19hdCDWVdosYrXkuLCk_75kmXP4-LnZq_EP5uIvGxjRAjPgK3GBemeKmOpQdc9sAwk3qdxHs_Cw6pzu-OC32G20 May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:17:29.457307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4de85b5a9fd04a9ba5d16da6d4816235"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-VolumesNegativeTest-724601828 May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 4de85b5a9fd04a9ba5d16da6d4816235 May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-VolumesNegativeTest-724601828 May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-VolumesNegativeTest-724601828-project May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 82a34231bf8e43808d6cb1cb55d93060 May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-VolumesNegativeTest-724601828-project May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Volume 4a702836-c26d-4c95-9880-3f95055dc105 could not be found. May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '4a702836-c26d-4c95-9880-3f95055dc105'} May 17 18:17:29.458909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4a702836-c26d-4c95-9880-3f95055dc105 could not be found. (HTTP 404) (Request-ID: req-de81011b-0fcb-4768-b2d1-dc3964eac6d8) May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:29.459868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:17:29.461227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4a702836-c26d-4c95-9880-3f95055dc105 could not be found. May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 18:17:29.463830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4a702836-c26d-4c95-9880-3f95055dc105 could not be found. May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4a702836-c26d-4c95-9880-3f95055dc105 could not be found. May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1c141cd3-a5e6-4604-a0c8-50a599b6aeb9 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] Returning 404 to user: Volume 4a702836-c26d-4c95-9880-3f95055dc105 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:17:29.466143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1c141cd3-a5e6-4604-a0c8-50a599b6aeb9 tempest-VolumesNegativeTest-724601828 tempest-VolumesNegativeTest-724601828-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/4a702836-c26d-4c95-9880-3f95055dc105" status: 404 len: 109 microversion: 2.1 time: 0.400716 May 17 18:17:29.468698 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 4/8] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:17:29 2022] GET /compute/v2.1/os-volumes/4a702836-c26d-4c95-9880-3f95055dc105 => generated 109 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:17:30.396604 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1008643524", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "networks": [{"uuid": "86ea7eef-47ee-4d2b-9ed2-27335ad66c99"}]}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:30.563018 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.network.neutron [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] validate_networks() for [('86ea7eef-47ee-4d2b-9ed2-27335ad66c99', None, None, None, None, None)] {{(pid=117098) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:17:30.861659 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-726c35a5-6c89-44c0-97b6-3295667a3169 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] Calling method '.version_select at 0x7f4e612000d0>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:31.021660 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-726c35a5-6c89-44c0-97b6-3295667a3169 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/6d7ba465-74b7-4ae6-b559-2fe218eae2bb" status: 200 len: 350 microversion: 2.1 time: 0.163671 May 17 18:17:31.022402 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 5/9] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:17:30 2022] GET /compute/v2.1/os-volumes/6d7ba465-74b7-4ae6-b559-2fe218eae2bb => generated 350 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:32.400485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Flavor limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:17:32.402209 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Image limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:17:32.402933 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Flavor pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:17:32.403506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Image pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:17:32.404120 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:17:32.434101 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:32.434559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:32.435380 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:32.435817 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:32.501471 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Getting quotas for project 230486e6ce974ab89147f39cbf941839. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:17:32.509140 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Getting quotas for user e64bccabbf334667a3e8de9f1b7bb878 and project 230486e6ce974ab89147f39cbf941839. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:17:32.524183 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Going to run 1 instances... {{(pid=117098) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:17:32.528968 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:17:32.689773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a4da48c3-c73a-4bae-bb98-bac456a91591 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.524589 May 17 18:17:32.693535 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 5/10] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:17:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2527 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:17:32.701915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f9243ff5-8c13-4611-b050-3423be07f6cf tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:32.702946 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f9243ff5-8c13-4611-b050-3423be07f6cf tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:32.932134 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f9243ff5-8c13-4611-b050-3423be07f6cf tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:32.972806 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f9243ff5-8c13-4611-b050-3423be07f6cf tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1215 microversion: 2.1 time: 0.274955 May 17 18:17:32.977239 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 6/11] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:32 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1215 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:33.011949 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fc56a729-7903-442f-a9a3-6f52a4271719 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] Calling method '.version_select at 0x7f4e609113a0>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:33.123053 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fc56a729-7903-442f-a9a3-6f52a4271719 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/f4139ebc-02ee-40ee-a7fc-c62844eeb42b" status: 200 len: 349 microversion: 2.1 time: 0.115370 May 17 18:17:33.123618 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 6/12] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:17:33 2022] GET /compute/v2.1/os-volumes/f4139ebc-02ee-40ee-a7fc-c62844eeb42b => generated 349 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:33.992364 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-62a13987-d4ed-47c1-93be-19d315d1892f tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:33.993670 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-62a13987-d4ed-47c1-93be-19d315d1892f tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:34.349701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-62a13987-d4ed-47c1-93be-19d315d1892f tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:34.359060 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-62a13987-d4ed-47c1-93be-19d315d1892f tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1215 microversion: 2.1 time: 0.370708 May 17 18:17:34.362135 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 7/13] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:33 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1215 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:34.889060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-419e7719-fce0-4764-afc1-158876e28100 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] Calling method '.version_select at 0x7f4e60911700>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:35.011611 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-419e7719-fce0-4764-afc1-158876e28100 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/7c00520c-9e94-4212-aa47-562ee412d95a" status: 200 len: 350 microversion: 2.1 time: 0.126899 May 17 18:17:35.014930 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 7/14] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:17:34 2022] GET /compute/v2.1/os-volumes/7c00520c-9e94-4212-aa47-562ee412d95a => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:35.028973 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e488cc3f-ba99-4909-b04c-14eb08fb1d34 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] Calling method '.version_select at 0x7f4e611bc4c0>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:35.360418 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e488cc3f-ba99-4909-b04c-14eb08fb1d34 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.338835 May 17 18:17:35.368774 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 8/15] 10.222.0.65 () {58 vars in 1133 bytes} [Tue May 17 18:17:35 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:35.382897 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-83b5ab5a-17df-4715-b42b-f48f13a45bc4 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] Calling method '.version_select at 0x7f4e60911820>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:35.390932 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-86c48114-2b21-4d6f-8777-5dd4ae1e23df tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:35.391701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-86c48114-2b21-4d6f-8777-5dd4ae1e23df tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:35.440814 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-86c48114-2b21-4d6f-8777-5dd4ae1e23df tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:35.449666 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-86c48114-2b21-4d6f-8777-5dd4ae1e23df tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:35.451329 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-86c48114-2b21-4d6f-8777-5dd4ae1e23df tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:35.451793 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-86c48114-2b21-4d6f-8777-5dd4ae1e23df tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:35.580279 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-83b5ab5a-17df-4715-b42b-f48f13a45bc4 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.208209 May 17 18:17:35.581297 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 8/16] 10.222.0.65 () {58 vars in 1148 bytes} [Tue May 17 18:17:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 692 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:35.598132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-75ae8ac3-1853-48a4-bb6a-aab1c26142b5 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] Calling method '.version_select at 0x7f4e609204c0>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:35.818345 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-75ae8ac3-1853-48a4-bb6a-aab1c26142b5 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] 10.222.0.65 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.226874 May 17 18:17:35.819745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 9/17] 10.222.0.65 () {58 vars in 1133 bytes} [Tue May 17 18:17:35 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:35.838975 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fb3b9cfe-9bae-4b67-b076-100cef2a1932 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] Calling method '.version_select at 0x7f4e60911940>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:35.993508 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fb3b9cfe-9bae-4b67-b076-100cef2a1932 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] 10.222.0.65 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.165351 May 17 18:17:35.995780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 10/18] 10.222.0.65 () {58 vars in 1166 bytes} [Tue May 17 18:17:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 352 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:17:36.008024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-afbbb3e6-2e12-4179-92f5-a99202050d19 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] Calling method '.version_select at 0x7f4e60903f70>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:36.008231 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-86c48114-2b21-4d6f-8777-5dd4ae1e23df tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:36.031783 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-86c48114-2b21-4d6f-8777-5dd4ae1e23df tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1211 microversion: 2.1 time: 0.655747 May 17 18:17:36.045342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 9/19] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:35 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1211 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:36.283028 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-afbbb3e6-2e12-4179-92f5-a99202050d19 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 692 microversion: 2.1 time: 0.279416 May 17 18:17:36.283866 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 11/20] 10.222.0.65 () {58 vars in 1169 bytes} [Tue May 17 18:17:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 692 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:36.297903 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ac9df5ad-1abc-4370-b9c4-709dd4c7f97e tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] Calling method '.version_select at 0x7f4e61138d30>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:36.609786 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ac9df5ad-1abc-4370-b9c4-709dd4c7f97e tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.313072 May 17 18:17:36.610798 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 10/21] 10.222.0.65 () {58 vars in 1154 bytes} [Tue May 17 18:17:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:36.628134 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-73d6c6c4-e560-4586-b3f7-9edd96bfd325 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] Calling method '.version_select at 0x7f4e609201f0>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:36.956444 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-73d6c6c4-e560-4586-b3f7-9edd96bfd325 tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 352 microversion: 2.1 time: 0.332912 May 17 18:17:36.958056 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 12/22] 10.222.0.65 () {58 vars in 1187 bytes} [Tue May 17 18:17:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 352 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:36.972732 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-87848067-2f4b-41b3-954b-a5e8c218a17f tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] Calling method '.version_select at 0x7f4e61143b80>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:37.056117 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-13c89d4a-61ed-4a05-818d-b505bfc19ebe tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:37.058156 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-13c89d4a-61ed-4a05-818d-b505bfc19ebe tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:37.112819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-13c89d4a-61ed-4a05-818d-b505bfc19ebe tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:37.123183 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-13c89d4a-61ed-4a05-818d-b505bfc19ebe tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:37.124719 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-13c89d4a-61ed-4a05-818d-b505bfc19ebe tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:37.133162 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-13c89d4a-61ed-4a05-818d-b505bfc19ebe tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:37.210799 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-87848067-2f4b-41b3-954b-a5e8c218a17f tempest-VolumesTestJSON-137717336 tempest-VolumesTestJSON-137717336-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.244522 May 17 18:17:37.211384 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 11/23] 10.222.0.65 () {58 vars in 1154 bytes} [Tue May 17 18:17:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:38.082400 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-13c89d4a-61ed-4a05-818d-b505bfc19ebe tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:38.120569 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-13c89d4a-61ed-4a05-818d-b505bfc19ebe tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1273 microversion: 2.1 time: 1.070584 May 17 18:17:38.121178 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 13/24] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:37 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1273 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:39.141030 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-191ce285-ca3d-46ce-a6b1-cb5bcc169cb6 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:39.142307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-191ce285-ca3d-46ce-a6b1-cb5bcc169cb6 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:39.179350 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-191ce285-ca3d-46ce-a6b1-cb5bcc169cb6 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:39.179776 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-191ce285-ca3d-46ce-a6b1-cb5bcc169cb6 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:39.183088 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-191ce285-ca3d-46ce-a6b1-cb5bcc169cb6 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:39.183562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-191ce285-ca3d-46ce-a6b1-cb5bcc169cb6 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:39.450109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-191ce285-ca3d-46ce-a6b1-cb5bcc169cb6 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:39.466977 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-191ce285-ca3d-46ce-a6b1-cb5bcc169cb6 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1273 microversion: 2.1 time: 0.332720 May 17 18:17:39.476024 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 12/25] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:39 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1273 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:40.484527 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b6aa5eff-2adb-404e-bf54-a1f5d791c8f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:40.488293 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b6aa5eff-2adb-404e-bf54-a1f5d791c8f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:40.504810 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b6aa5eff-2adb-404e-bf54-a1f5d791c8f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:40.507165 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b6aa5eff-2adb-404e-bf54-a1f5d791c8f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:40.511076 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b6aa5eff-2adb-404e-bf54-a1f5d791c8f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:40.517950 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b6aa5eff-2adb-404e-bf54-a1f5d791c8f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:40.704032 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b6aa5eff-2adb-404e-bf54-a1f5d791c8f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:40.718611 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b6aa5eff-2adb-404e-bf54-a1f5d791c8f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1273 microversion: 2.1 time: 0.234801 May 17 18:17:40.721246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 14/26] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:40 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:41.736219 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e0a6369a-4d0d-4b59-a948-d3042eec2da0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:41.737753 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e0a6369a-4d0d-4b59-a948-d3042eec2da0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:41.749750 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0a6369a-4d0d-4b59-a948-d3042eec2da0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:41.751354 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0a6369a-4d0d-4b59-a948-d3042eec2da0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:41.753805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0a6369a-4d0d-4b59-a948-d3042eec2da0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:41.764008 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0a6369a-4d0d-4b59-a948-d3042eec2da0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:42.972405 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e0a6369a-4d0d-4b59-a948-d3042eec2da0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:43.026381 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e0a6369a-4d0d-4b59-a948-d3042eec2da0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 1.292762 May 17 18:17:43.029616 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 13/27] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:41 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:44.047808 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e20bd5c3-506c-4480-b97f-4fedf2e2f084 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:44.053545 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e20bd5c3-506c-4480-b97f-4fedf2e2f084 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:44.067493 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e20bd5c3-506c-4480-b97f-4fedf2e2f084 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:44.068261 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e20bd5c3-506c-4480-b97f-4fedf2e2f084 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:44.069889 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e20bd5c3-506c-4480-b97f-4fedf2e2f084 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:44.071868 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e20bd5c3-506c-4480-b97f-4fedf2e2f084 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:44.407192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e20bd5c3-506c-4480-b97f-4fedf2e2f084 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:44.421430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e20bd5c3-506c-4480-b97f-4fedf2e2f084 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.378539 May 17 18:17:44.426061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 15/28] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:44 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:44.632897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a38859ec-f0ea-4ebd-bf79-1e7177aa0b64 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: .version_select at 0x7f4e61113af0>, body: {"keypair": {"name": "tempest-keypair-1198825939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDO679MAcQN3RAf+uj3936al8ke/UwuV3/itkXE3O5vwI7yXf9VctWaTDUY4vk3H2sYKhTXThPAD1D8ttwWa7lg5PCOyHUyrAeSCg1eTfSgSmC6UBkOwioC6OpIsmPIdmQ=="}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:44.740300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-76b8c796-265b-40b0-b5a2-ef21d4c27ed8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Action: 'create', calling method: .version_select at 0x7f4e5bfd4790>, body: {"keypair": {"name": "tempest-keypair-1637869322", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEJVxY7Kx29F02bJTiClgCQU+qA5B/sl+YgDX8Qx/8ZlejSsmMGLPcvZP5xQymFpjpDfL5i1Edj8AkS/thpoSO2SHMT5143Hq27QNyqtbgZGDC/KzKgtzg4ImRfTfbmTQ=="}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:44.772460 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-a38859ec-f0ea-4ebd-bf79-1e7177aa0b64 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'key_pairs'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:17:44.790987 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-a38859ec-f0ea-4ebd-bf79-1e7177aa0b64 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for user 13b4ec46d3cb49faba3f063dcfd644c3 and project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'key_pairs'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:17:44.800622 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-76b8c796-265b-40b0-b5a2-ef21d4c27ed8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Getting quotas for project cd7eb45f1cd74f84943f4b991986973d. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:17:44.811141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-76b8c796-265b-40b0-b5a2-ef21d4c27ed8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Getting quotas for user 356af648841c44eeab0bd9c7f78f600a and project cd7eb45f1cd74f84943f4b991986973d. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:17:44.933891 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-76b8c796-265b-40b0-b5a2-ef21d4c27ed8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.500691 May 17 18:17:44.934833 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 16/29] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 17 18:17:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:44.985208 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a38859ec-f0ea-4ebd-bf79-1e7177aa0b64 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.610779 May 17 18:17:44.985962 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 14/30] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 17 18:17:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:45.438546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-94c3112a-c6e9-4a55-8bd8-f402360b96fb tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:45.439092 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-94c3112a-c6e9-4a55-8bd8-f402360b96fb tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:45.451845 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-94c3112a-c6e9-4a55-8bd8-f402360b96fb tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:45.452302 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-94c3112a-c6e9-4a55-8bd8-f402360b96fb tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:45.453138 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-94c3112a-c6e9-4a55-8bd8-f402360b96fb tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:45.453616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-94c3112a-c6e9-4a55-8bd8-f402360b96fb tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:45.851552 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-94c3112a-c6e9-4a55-8bd8-f402360b96fb tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:45.861336 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-94c3112a-c6e9-4a55-8bd8-f402360b96fb tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.426937 May 17 18:17:45.862143 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 17/31] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:45 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:46.879791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-74a145ce-228c-471b-90a1-faedbe387c15 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:46.881062 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-74a145ce-228c-471b-90a1-faedbe387c15 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:46.890683 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-74a145ce-228c-471b-90a1-faedbe387c15 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:46.902215 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-74a145ce-228c-471b-90a1-faedbe387c15 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:46.907787 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-74a145ce-228c-471b-90a1-faedbe387c15 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:46.908392 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-74a145ce-228c-471b-90a1-faedbe387c15 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:47.055577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1bc47055-5a09-40f0-95d2-6c386b3d342f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Action: 'create', calling method: .version_select at 0x7f4e6005f700>, body: {"keypair": {"name": "tempest-keypair-1787987943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1LVEyYxyh94Oa4tzLg8Um4mohZ37LQsfORlUR7iYK07xZnEakkHX/2zfnCtlNt2L2dbFaY4QyUMfVmxXEmUvJ79OrvdKmhZvIRA0jn9p86Z+QamG9OMZKtTpSZBdOT1g=="}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:47.094825 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-1bc47055-5a09-40f0-95d2-6c386b3d342f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Getting quotas for project 379adfd2520a4d2dba04fca7fa3a1d95. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:17:47.110554 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-1bc47055-5a09-40f0-95d2-6c386b3d342f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Getting quotas for user 43620937739e45d3bb7849f98d0e6cce and project 379adfd2520a4d2dba04fca7fa3a1d95. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:17:47.169659 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1bc47055-5a09-40f0-95d2-6c386b3d342f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.235564 May 17 18:17:47.170812 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 18/32] 10.222.0.65 () {62 vars in 1199 bytes} [Tue May 17 18:17:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 237 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 18:17:48.696550 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-74a145ce-228c-471b-90a1-faedbe387c15 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:48.732927 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-74a145ce-228c-471b-90a1-faedbe387c15 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 1.857110 May 17 18:17:48.738778 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 15/33] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:46 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 1863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:49.755658 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c0bc0e47-1fa8-4da0-80c0-30c1bc8221c1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:49.756303 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c0bc0e47-1fa8-4da0-80c0-30c1bc8221c1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:49.800455 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0bc0e47-1fa8-4da0-80c0-30c1bc8221c1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:49.801128 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0bc0e47-1fa8-4da0-80c0-30c1bc8221c1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:49.802200 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0bc0e47-1fa8-4da0-80c0-30c1bc8221c1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:49.802806 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0bc0e47-1fa8-4da0-80c0-30c1bc8221c1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:51.319024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c0bc0e47-1fa8-4da0-80c0-30c1bc8221c1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:51.331781 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c0bc0e47-1fa8-4da0-80c0-30c1bc8221c1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 1.576548 May 17 18:17:51.332796 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 19/34] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:49 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:52.095096 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-700037017", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:52.350217 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e58384cd-746b-46cd-913c-77917a88da33 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:52.351801 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e58384cd-746b-46cd-913c-77917a88da33 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:52.373230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e58384cd-746b-46cd-913c-77917a88da33 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:52.382542 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e58384cd-746b-46cd-913c-77917a88da33 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:52.383678 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e58384cd-746b-46cd-913c-77917a88da33 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:52.409964 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e58384cd-746b-46cd-913c-77917a88da33 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:52.488168 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] validate_networks() for [('3108c074-e89d-458b-b4f7-22798aa06562', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:17:53.592873 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e58384cd-746b-46cd-913c-77917a88da33 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:53.612664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e58384cd-746b-46cd-913c-77917a88da33 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 1.256990 May 17 18:17:53.617569 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 20/35] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:52 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:17:53.654612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1507195305", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bbec44d-dbfb-4f33-a578-9ea7e3744727"}], "security_groups": [{"name": "tempest-securitygroup--827510125"}], "key_name": "tempest-keypair-1198825939", "user_data": "}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:54.139487 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.network.neutron [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] validate_networks() for [('3bbec44d-dbfb-4f33-a578-9ea7e3744727', None, None, None, None, None)] {{(pid=117098) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:17:54.394319 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:17:54.395373 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:17:54.396167 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:17:54.396741 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:17:54.397854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:17:54.420302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:54.421513 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:54.424060 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:54.425127 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:54.504228 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Getting quotas for project b7d713a65f9e4071988e5df2fbf90b17. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:17:54.523205 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Getting quotas for user 5e6f035cadd24a59803eec21c7b9e2c5 and project b7d713a65f9e4071988e5df2fbf90b17. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:17:54.543176 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:17:54.574084 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:17:54.740115 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-3dac89c8-1d8c-4b07-b316-84bf9c737f9a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.995643 May 17 18:17:54.742094 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 16/36] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:17:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 2999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:17:54.750825 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1256333105", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68688597-c210-4792-9189-73af0d2f702a"}], "security_groups": [{"name": "tempest-securitygroup--1537327932"}], "key_name": "tempest-keypair-1637869322", "user_data": "}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:55.161827 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] validate_networks() for [('68688597-c210-4792-9189-73af0d2f702a', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:17:55.315520 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Flavor limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:17:55.316032 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Image limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:17:55.316419 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Flavor pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:17:55.317248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Image pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:17:55.317705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:17:55.337337 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:55.344367 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:55.345342 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:55.345956 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:55.416994 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:17:55.434224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for user 13b4ec46d3cb49faba3f063dcfd644c3 and project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:17:55.471375 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Going to run 1 instances... {{(pid=117098) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:17:55.474938 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:17:55.579574 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-acfdb87d-1630-4dcb-b534-e3f06aeded39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.961581 May 17 18:17:55.585884 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 21/37] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:17:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 1972 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:17:55.929924 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-dcfb3b32-5b04-4a56-a993-9975d3d7e8ee req-fb2ff3f3-a484-4524-992e-6f0809e4f61d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb69ecb4-59b0-447d-86ef-b0cd8ce232b3", "tag": "72497b8a-820a-454f-9db2-9a0b38daf150"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:55.969687 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-dcfb3b32-5b04-4a56-a993-9975d3d7e8ee req-fb2ff3f3-a484-4524-992e-6f0809e4f61d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:55.974476 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-dcfb3b32-5b04-4a56-a993-9975d3d7e8ee req-fb2ff3f3-a484-4524-992e-6f0809e4f61d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:56.056794 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-dcfb3b32-5b04-4a56-a993-9975d3d7e8ee req-fb2ff3f3-a484-4524-992e-6f0809e4f61d service nova] Creating event network-changed:72497b8a-820a-454f-9db2-9a0b38daf150 for instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 on hv-cinder-83736 May 17 18:17:56.060445 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-dcfb3b32-5b04-4a56-a993-9975d3d7e8ee req-fb2ff3f3-a484-4524-992e-6f0809e4f61d service nova] Acquired lock "compute-rpcapi-router" {{(pid=117098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 18:17:56.067741 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4896d049-a51e-4f8d-b27a-7acc0210638b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:56.069400 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4896d049-a51e-4f8d-b27a-7acc0210638b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:56.071286 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4896d049-a51e-4f8d-b27a-7acc0210638b None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:56.073142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4896d049-a51e-4f8d-b27a-7acc0210638b None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:56.111718 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.compute.rpcapi [None req-4896d049-a51e-4f8d-b27a-7acc0210638b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 18:17:56.122767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4896d049-a51e-4f8d-b27a-7acc0210638b None None] Releasing lock "compute-rpcapi-router" {{(pid=117098) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 18:17:56.160075 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4896d049-a51e-4f8d-b27a-7acc0210638b None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.572356 May 17 18:17:56.167105 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 22/38] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:17:56.173016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fdbb7c29-baee-45ea-8007-3e8ff456e2b8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:56.189152 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fdbb7c29-baee-45ea-8007-3e8ff456e2b8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:56.218304 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fdbb7c29-baee-45ea-8007-3e8ff456e2b8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:56.219155 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fdbb7c29-baee-45ea-8007-3e8ff456e2b8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:56.220607 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fdbb7c29-baee-45ea-8007-3e8ff456e2b8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:56.221857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fdbb7c29-baee-45ea-8007-3e8ff456e2b8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:56.351866 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:17:56.353111 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:17:56.353702 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:17:56.354321 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:17:56.354940 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:17:56.384025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:56.389309 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:56.401009 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:56.406167 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:56.463879 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Getting quotas for project cd7eb45f1cd74f84943f4b991986973d. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:17:56.474721 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Getting quotas for user 356af648841c44eeab0bd9c7f78f600a and project cd7eb45f1cd74f84943f4b991986973d. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:17:56.517548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:17:56.537839 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:17:56.737102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6e93a0ec-ced1-4bc4-9c1b-554202ec52da tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.993422 May 17 18:17:56.745619 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 17/39] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:17:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2003 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:17:56.768993 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-82f127f8-0b9b-4c40-8c40-f5db7922b569 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:56.777863 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-82f127f8-0b9b-4c40-8c40-f5db7922b569 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:56.798701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-82f127f8-0b9b-4c40-8c40-f5db7922b569 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:56.807876 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-82f127f8-0b9b-4c40-8c40-f5db7922b569 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:56.808893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-82f127f8-0b9b-4c40-8c40-f5db7922b569 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:56.809428 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-82f127f8-0b9b-4c40-8c40-f5db7922b569 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:57.018677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-82f127f8-0b9b-4c40-8c40-f5db7922b569 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:57.029929 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-82f127f8-0b9b-4c40-8c40-f5db7922b569 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1217 microversion: 2.1 time: 0.276045 May 17 18:17:57.034623 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 18/40] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:56 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1217 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:57.063001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7b852475-e565-4c8f-8dfb-620351c40a39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:57.068636 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7b852475-e565-4c8f-8dfb-620351c40a39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:57.074199 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fdbb7c29-baee-45ea-8007-3e8ff456e2b8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:57.092820 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b852475-e565-4c8f-8dfb-620351c40a39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:57.095413 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b852475-e565-4c8f-8dfb-620351c40a39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:57.096361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b852475-e565-4c8f-8dfb-620351c40a39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:57.098283 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fdbb7c29-baee-45ea-8007-3e8ff456e2b8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.929817 May 17 18:17:57.101057 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b852475-e565-4c8f-8dfb-620351c40a39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:57.101627 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 23/41] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:56 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:57.126674 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-dd55cdbd-617f-484b-8b03-0de88281c369 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:57.131203 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-dd55cdbd-617f-484b-8b03-0de88281c369 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:57.324760 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-dd55cdbd-617f-484b-8b03-0de88281c369 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:57.354244 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-dd55cdbd-617f-484b-8b03-0de88281c369 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1238 microversion: 2.1 time: 0.250326 May 17 18:17:57.356992 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 24/42] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:57 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1238 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:57.377117 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7b852475-e565-4c8f-8dfb-620351c40a39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:57.387228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-86190815", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:57.391023 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7b852475-e565-4c8f-8dfb-620351c40a39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1246 microversion: 2.1 time: 0.352951 May 17 18:17:57.391668 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 19/43] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:57 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1246 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:57.509179 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.network.neutron [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] validate_networks() for [('3108c074-e89d-458b-b4f7-22798aa06562', None, None, None, None, None)] {{(pid=117098) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:17:57.555539 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-647332445", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6640be3d-e392-4726-8d89-eb40f1262219"}], "security_groups": [{"name": "tempest-securitygroup--2144934008"}], "key_name": "tempest-keypair-1787987943", "user_data": "}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:17:57.825008 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] validate_networks() for [('6640be3d-e392-4726-8d89-eb40f1262219', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:17:58.374388 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Flavor limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:17:58.374861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Image limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:17:58.375294 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Flavor pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:17:58.375717 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Image pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:17:58.376271 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:17:58.385394 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.386093 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.386750 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.387187 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.403992 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Getting quotas for project b7d713a65f9e4071988e5df2fbf90b17. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:17:58.407880 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Getting quotas for user 5e6f035cadd24a59803eec21c7b9e2c5 and project b7d713a65f9e4071988e5df2fbf90b17. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:17:58.421085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Going to run 1 instances... {{(pid=117098) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:17:58.422033 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:17:58.480517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7f0c1b17-c968-442b-ac0f-cb46835da68c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.114305 May 17 18:17:58.480517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 25/44] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:17:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1116 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:17:58.489589 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cd3733ce-6d1d-46d8-807b-ac9e36400111 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:58.490145 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cd3733ce-6d1d-46d8-807b-ac9e36400111 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:58.499277 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd3733ce-6d1d-46d8-807b-ac9e36400111 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.499974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd3733ce-6d1d-46d8-807b-ac9e36400111 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.500912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd3733ce-6d1d-46d8-807b-ac9e36400111 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.501351 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd3733ce-6d1d-46d8-807b-ac9e36400111 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.520608 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:17:58.521117 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:17:58.521601 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:17:58.522030 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:17:58.522473 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:17:58.548117 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.549574 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.552316 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.552775 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.614048 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Getting quotas for project 379adfd2520a4d2dba04fca7fa3a1d95. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:17:58.627481 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Getting quotas for user 43620937739e45d3bb7849f98d0e6cce and project 379adfd2520a4d2dba04fca7fa3a1d95. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:17:58.656071 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:17:58.658638 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:17:58.744502 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cd3733ce-6d1d-46d8-807b-ac9e36400111 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:58.753335 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b2c2edc1-545a-4b35-98cf-63cb87dd3a02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.206583 May 17 18:17:58.754301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cd3733ce-6d1d-46d8-807b-ac9e36400111 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.278492 May 17 18:17:58.755396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 26/45] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:58 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:58.763768 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9eaf8e5e-cb31-460f-b1b9-a498dca745d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:58.764855 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 20/46] 10.222.0.65 () {62 vars in 1187 bytes} [Tue May 17 18:17:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 1219 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 17 18:17:58.772439 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e3cbd32b-e937-47ca-b8ab-18c8f4898ff3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:58.774574 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e3cbd32b-e937-47ca-b8ab-18c8f4898ff3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:58.775899 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9eaf8e5e-cb31-460f-b1b9-a498dca745d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:58.789230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9eaf8e5e-cb31-460f-b1b9-a498dca745d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.794121 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3cbd32b-e937-47ca-b8ab-18c8f4898ff3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.794638 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3cbd32b-e937-47ca-b8ab-18c8f4898ff3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.796008 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3cbd32b-e937-47ca-b8ab-18c8f4898ff3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.796533 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3cbd32b-e937-47ca-b8ab-18c8f4898ff3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.808359 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9eaf8e5e-cb31-460f-b1b9-a498dca745d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.812749 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9eaf8e5e-cb31-460f-b1b9-a498dca745d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:58.813219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9eaf8e5e-cb31-460f-b1b9-a498dca745d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:58.959731 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e3cbd32b-e937-47ca-b8ab-18c8f4898ff3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:58.984619 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e3cbd32b-e937-47ca-b8ab-18c8f4898ff3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1294 microversion: 2.1 time: 0.218590 May 17 18:17:58.985223 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 21/47] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:58 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1294 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:59.002791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-142cc6ab-a72c-4ef3-a94b-fb097706a101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:59.013450 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-142cc6ab-a72c-4ef3-a94b-fb097706a101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:59.051302 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9eaf8e5e-cb31-460f-b1b9-a498dca745d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:59.062045 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9eaf8e5e-cb31-460f-b1b9-a498dca745d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1242 microversion: 2.1 time: 0.305063 May 17 18:17:59.063317 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 27/48] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:58 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1242 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:59.078216 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-39198f48-42a8-4cdb-b814-d4a030419fc7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:59.079974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-39198f48-42a8-4cdb-b814-d4a030419fc7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:59.159670 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-142cc6ab-a72c-4ef3-a94b-fb097706a101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:59.168632 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-142cc6ab-a72c-4ef3-a94b-fb097706a101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1220 microversion: 2.1 time: 0.182311 May 17 18:17:59.181086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 22/49] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:58 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1220 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:17:59.223761 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-39198f48-42a8-4cdb-b814-d4a030419fc7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:59.232820 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-39198f48-42a8-4cdb-b814-d4a030419fc7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:59.235785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-39198f48-42a8-4cdb-b814-d4a030419fc7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:59.237131 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-39198f48-42a8-4cdb-b814-d4a030419fc7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1281 microversion: 2.20 time: 0.172635 May 17 18:17:59.237948 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 28/50] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:17:59 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1281 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:17:59.774305 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0d6aa9e5-d39c-42d6-a08f-bfb25660ecb3 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:17:59.774937 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0d6aa9e5-d39c-42d6-a08f-bfb25660ecb3 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:17:59.784013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0d6aa9e5-d39c-42d6-a08f-bfb25660ecb3 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:59.784013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0d6aa9e5-d39c-42d6-a08f-bfb25660ecb3 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:59.784013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0d6aa9e5-d39c-42d6-a08f-bfb25660ecb3 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:17:59.784013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0d6aa9e5-d39c-42d6-a08f-bfb25660ecb3 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:17:59.950575 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0d6aa9e5-d39c-42d6-a08f-bfb25660ecb3 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:17:59.959139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0d6aa9e5-d39c-42d6-a08f-bfb25660ecb3 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.188538 May 17 18:17:59.960577 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 23/51] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:59 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:00.006328 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-07cdfd40-16d7-4287-ae91-94c22c81315b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:00.008439 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-07cdfd40-16d7-4287-ae91-94c22c81315b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:00.023055 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-07cdfd40-16d7-4287-ae91-94c22c81315b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.023512 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-07cdfd40-16d7-4287-ae91-94c22c81315b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.024290 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-07cdfd40-16d7-4287-ae91-94c22c81315b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.024890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-07cdfd40-16d7-4287-ae91-94c22c81315b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.081202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-71c0f8f4-549f-4d25-8472-89bcf51ccdfd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:00.081873 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-71c0f8f4-549f-4d25-8472-89bcf51ccdfd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:00.092037 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-71c0f8f4-549f-4d25-8472-89bcf51ccdfd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.092502 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-71c0f8f4-549f-4d25-8472-89bcf51ccdfd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.095087 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-71c0f8f4-549f-4d25-8472-89bcf51ccdfd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.095562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-71c0f8f4-549f-4d25-8472-89bcf51ccdfd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.113686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-07cdfd40-16d7-4287-ae91-94c22c81315b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:00.125335 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-07cdfd40-16d7-4287-ae91-94c22c81315b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1294 microversion: 2.1 time: 0.125995 May 17 18:18:00.154416 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 29/52] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:17:59 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1294 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:00.187105 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-afad7ef4-f032-416c-abfe-21e7e55f3ae2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:00.187850 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-afad7ef4-f032-416c-abfe-21e7e55f3ae2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:00.203391 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afad7ef4-f032-416c-abfe-21e7e55f3ae2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.204018 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afad7ef4-f032-416c-abfe-21e7e55f3ae2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.209843 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afad7ef4-f032-416c-abfe-21e7e55f3ae2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.211265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afad7ef4-f032-416c-abfe-21e7e55f3ae2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.213047 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-71c0f8f4-549f-4d25-8472-89bcf51ccdfd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:00.224407 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-71c0f8f4-549f-4d25-8472-89bcf51ccdfd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1234 microversion: 2.1 time: 0.148272 May 17 18:18:00.230962 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 24/53] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:00 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1234 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:00.256117 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-dc8422a4-3ded-43b1-a7f2-6fcb84911b2e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:00.257896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-dc8422a4-3ded-43b1-a7f2-6fcb84911b2e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:00.274169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc8422a4-3ded-43b1-a7f2-6fcb84911b2e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.274776 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc8422a4-3ded-43b1-a7f2-6fcb84911b2e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.275763 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc8422a4-3ded-43b1-a7f2-6fcb84911b2e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:00.276395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc8422a4-3ded-43b1-a7f2-6fcb84911b2e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:00.373144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-afad7ef4-f032-416c-abfe-21e7e55f3ae2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:00.390731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-afad7ef4-f032-416c-abfe-21e7e55f3ae2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1224 microversion: 2.1 time: 0.209248 May 17 18:18:00.401179 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 30/54] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:00 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1224 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:00.469203 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dc8422a4-3ded-43b1-a7f2-6fcb84911b2e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:00.496704 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dc8422a4-3ded-43b1-a7f2-6fcb84911b2e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:00.498575 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dc8422a4-3ded-43b1-a7f2-6fcb84911b2e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:00.503000 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-dc8422a4-3ded-43b1-a7f2-6fcb84911b2e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1285 microversion: 2.20 time: 0.249605 May 17 18:18:00.505105 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 25/55] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:00 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1285 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:00.995795 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4d1cd194-aebb-4c12-909f-e6b986edc77b tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:00.998846 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4d1cd194-aebb-4c12-909f-e6b986edc77b tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:01.015083 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4d1cd194-aebb-4c12-909f-e6b986edc77b tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.018061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4d1cd194-aebb-4c12-909f-e6b986edc77b tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.020437 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4d1cd194-aebb-4c12-909f-e6b986edc77b tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.022836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4d1cd194-aebb-4c12-909f-e6b986edc77b tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.162173 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-efd547c7-3af6-421e-b205-7ddaa6391b93 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:01.162948 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-efd547c7-3af6-421e-b205-7ddaa6391b93 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:01.176414 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-efd547c7-3af6-421e-b205-7ddaa6391b93 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.179447 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-efd547c7-3af6-421e-b205-7ddaa6391b93 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.183481 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-efd547c7-3af6-421e-b205-7ddaa6391b93 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.186376 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-efd547c7-3af6-421e-b205-7ddaa6391b93 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.359417 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-efd547c7-3af6-421e-b205-7ddaa6391b93 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:01.373743 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-efd547c7-3af6-421e-b205-7ddaa6391b93 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1300 microversion: 2.1 time: 0.214272 May 17 18:18:01.375866 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 26/56] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:01 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1300 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:01.390287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4d1cd194-aebb-4c12-909f-e6b986edc77b tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:01.399067 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4d1cd194-aebb-4c12-909f-e6b986edc77b tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.426167 May 17 18:18:01.399650 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 31/57] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:00 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:01.399858 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-15a87d83-063b-4ef7-b730-29dbd9e29bba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:01.402507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-15a87d83-063b-4ef7-b730-29dbd9e29bba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:01.416792 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-92ec86ea-7548-47c8-a564-42da81c00290 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:01.417441 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-92ec86ea-7548-47c8-a564-42da81c00290 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:01.417853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-15a87d83-063b-4ef7-b730-29dbd9e29bba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.418321 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-15a87d83-063b-4ef7-b730-29dbd9e29bba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.419173 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-15a87d83-063b-4ef7-b730-29dbd9e29bba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.419573 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-15a87d83-063b-4ef7-b730-29dbd9e29bba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.430359 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-92ec86ea-7548-47c8-a564-42da81c00290 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.433157 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-92ec86ea-7548-47c8-a564-42da81c00290 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.436228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-92ec86ea-7548-47c8-a564-42da81c00290 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.436228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-92ec86ea-7548-47c8-a564-42da81c00290 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.791920 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-15a87d83-063b-4ef7-b730-29dbd9e29bba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:01.800814 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-15a87d83-063b-4ef7-b730-29dbd9e29bba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1298 microversion: 2.1 time: 0.423620 May 17 18:18:01.801510 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 27/58] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:01 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1298 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:01.838878 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8d2b5a02-d47b-42f3-b82a-5a9e760b8758 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:01.839529 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8d2b5a02-d47b-42f3-b82a-5a9e760b8758 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:01.859837 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d2b5a02-d47b-42f3-b82a-5a9e760b8758 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.860302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d2b5a02-d47b-42f3-b82a-5a9e760b8758 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.861114 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d2b5a02-d47b-42f3-b82a-5a9e760b8758 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:01.861594 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d2b5a02-d47b-42f3-b82a-5a9e760b8758 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:01.970456 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-92ec86ea-7548-47c8-a564-42da81c00290 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:01.995378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-92ec86ea-7548-47c8-a564-42da81c00290 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1272 microversion: 2.1 time: 0.589862 May 17 18:18:01.999822 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 32/59] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:01 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1272 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:02.391644 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6320140e-1a8e-43c3-a981-f52af5fbe09f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:02.392275 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6320140e-1a8e-43c3-a981-f52af5fbe09f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:02.406846 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6320140e-1a8e-43c3-a981-f52af5fbe09f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:02.407686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6320140e-1a8e-43c3-a981-f52af5fbe09f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:02.408684 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6320140e-1a8e-43c3-a981-f52af5fbe09f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:02.409277 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6320140e-1a8e-43c3-a981-f52af5fbe09f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:02.419975 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8d2b5a02-d47b-42f3-b82a-5a9e760b8758 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:02.429289 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8d2b5a02-d47b-42f3-b82a-5a9e760b8758 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:02.449903 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8d2b5a02-d47b-42f3-b82a-5a9e760b8758 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:02.451712 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8d2b5a02-d47b-42f3-b82a-5a9e760b8758 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1351 microversion: 2.20 time: 0.648949 May 17 18:18:02.452916 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 28/60] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:01 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1351 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:02.461325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-65d3fad2-9020-41be-aeb8-d5dae8346b93 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:02.467570 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-65d3fad2-9020-41be-aeb8-d5dae8346b93 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:02.488703 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-65d3fad2-9020-41be-aeb8-d5dae8346b93 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:02.492048 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-65d3fad2-9020-41be-aeb8-d5dae8346b93 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:02.492934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-65d3fad2-9020-41be-aeb8-d5dae8346b93 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:02.493383 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-65d3fad2-9020-41be-aeb8-d5dae8346b93 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:02.649183 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6320140e-1a8e-43c3-a981-f52af5fbe09f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:02.665266 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6320140e-1a8e-43c3-a981-f52af5fbe09f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1300 microversion: 2.1 time: 0.274695 May 17 18:18:02.668168 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 33/61] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:02 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1300 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:02.824450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c2e324b5-6a57-4469-a2d3-2d64a2aa6b98 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:02.825075 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c2e324b5-6a57-4469-a2d3-2d64a2aa6b98 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:02.840115 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c2e324b5-6a57-4469-a2d3-2d64a2aa6b98 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:02.840777 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c2e324b5-6a57-4469-a2d3-2d64a2aa6b98 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:02.841759 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c2e324b5-6a57-4469-a2d3-2d64a2aa6b98 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:02.842351 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c2e324b5-6a57-4469-a2d3-2d64a2aa6b98 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:02.904627 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-65d3fad2-9020-41be-aeb8-d5dae8346b93 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:02.912114 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-65d3fad2-9020-41be-aeb8-d5dae8346b93 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.457856 May 17 18:18:02.922810 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 29/62] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:02 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:02.999637 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c2e324b5-6a57-4469-a2d3-2d64a2aa6b98 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:03.012461 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c2963bf1-48a4-4afc-af7a-7e5488465a24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:03.013500 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c2963bf1-48a4-4afc-af7a-7e5488465a24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:03.019255 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c2e324b5-6a57-4469-a2d3-2d64a2aa6b98 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1296 microversion: 2.1 time: 0.201751 May 17 18:18:03.020546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 34/63] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:02 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1296 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:03.023113 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c2963bf1-48a4-4afc-af7a-7e5488465a24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.023841 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c2963bf1-48a4-4afc-af7a-7e5488465a24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:03.034669 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c2963bf1-48a4-4afc-af7a-7e5488465a24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.035457 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c2963bf1-48a4-4afc-af7a-7e5488465a24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:03.216485 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c2963bf1-48a4-4afc-af7a-7e5488465a24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:03.226884 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c2963bf1-48a4-4afc-af7a-7e5488465a24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1278 microversion: 2.1 time: 0.218032 May 17 18:18:03.227753 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 30/64] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:03 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1278 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:03.472447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a9e191e3-4a31-43a8-b869-5715bb634d5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:03.474561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a9e191e3-4a31-43a8-b869-5715bb634d5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:03.491476 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a9e191e3-4a31-43a8-b869-5715bb634d5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.492199 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a9e191e3-4a31-43a8-b869-5715bb634d5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:03.493199 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a9e191e3-4a31-43a8-b869-5715bb634d5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.495115 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a9e191e3-4a31-43a8-b869-5715bb634d5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:03.608370 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a9e191e3-4a31-43a8-b869-5715bb634d5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:03.616882 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a9e191e3-4a31-43a8-b869-5715bb634d5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:03.619396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a9e191e3-4a31-43a8-b869-5715bb634d5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:03.627466 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a9e191e3-4a31-43a8-b869-5715bb634d5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1339 microversion: 2.20 time: 0.160746 May 17 18:18:03.640728 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 35/65] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:03 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1339 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:03.690294 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-71786af5-79b8-4cc4-93b5-6a97c5dae5a3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:03.691049 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-71786af5-79b8-4cc4-93b5-6a97c5dae5a3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:03.701497 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-71786af5-79b8-4cc4-93b5-6a97c5dae5a3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.702405 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-71786af5-79b8-4cc4-93b5-6a97c5dae5a3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:03.703363 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-71786af5-79b8-4cc4-93b5-6a97c5dae5a3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.704112 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-71786af5-79b8-4cc4-93b5-6a97c5dae5a3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:03.855946 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-71786af5-79b8-4cc4-93b5-6a97c5dae5a3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:03.872764 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-71786af5-79b8-4cc4-93b5-6a97c5dae5a3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1300 microversion: 2.1 time: 0.187985 May 17 18:18:03.873625 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 31/66] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:03 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1300 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:03.939075 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d95ad954-3f54-4a9a-acbe-5fca8aca0e89 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:03.940070 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d95ad954-3f54-4a9a-acbe-5fca8aca0e89 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:03.949101 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d95ad954-3f54-4a9a-acbe-5fca8aca0e89 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.955187 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d95ad954-3f54-4a9a-acbe-5fca8aca0e89 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:03.956269 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d95ad954-3f54-4a9a-acbe-5fca8aca0e89 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:03.956843 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d95ad954-3f54-4a9a-acbe-5fca8aca0e89 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:04.038369 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-351dca14-e18a-46ba-aa51-fe3d4fa6b101 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:04.040209 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-351dca14-e18a-46ba-aa51-fe3d4fa6b101 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:04.059281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-351dca14-e18a-46ba-aa51-fe3d4fa6b101 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:04.059742 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-351dca14-e18a-46ba-aa51-fe3d4fa6b101 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:04.060533 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-351dca14-e18a-46ba-aa51-fe3d4fa6b101 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:04.060975 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-351dca14-e18a-46ba-aa51-fe3d4fa6b101 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:04.764242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d95ad954-3f54-4a9a-acbe-5fca8aca0e89 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:04.765595 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-351dca14-e18a-46ba-aa51-fe3d4fa6b101 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:04.773823 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-351dca14-e18a-46ba-aa51-fe3d4fa6b101 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.739188 May 17 18:18:04.776639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 32/67] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:04 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:04.784270 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d95ad954-3f54-4a9a-acbe-5fca8aca0e89 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.849249 May 17 18:18:04.786361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0ad6eedd-f068-4b2b-aee8-15a45978193e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:04.788270 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 36/68] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:03 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:04.789164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0ad6eedd-f068-4b2b-aee8-15a45978193e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:04.797411 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1043df15-5dfe-4733-b885-f80a6f6579bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:04.800977 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1043df15-5dfe-4733-b885-f80a6f6579bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:04.816545 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1043df15-5dfe-4733-b885-f80a6f6579bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:04.818045 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1043df15-5dfe-4733-b885-f80a6f6579bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:04.818202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0ad6eedd-f068-4b2b-aee8-15a45978193e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:04.820631 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1043df15-5dfe-4733-b885-f80a6f6579bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:04.821244 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1043df15-5dfe-4733-b885-f80a6f6579bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:04.821412 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0ad6eedd-f068-4b2b-aee8-15a45978193e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:04.822333 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0ad6eedd-f068-4b2b-aee8-15a45978193e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:04.822789 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0ad6eedd-f068-4b2b-aee8-15a45978193e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:05.287845 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0ad6eedd-f068-4b2b-aee8-15a45978193e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:05.302265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0ad6eedd-f068-4b2b-aee8-15a45978193e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1278 microversion: 2.1 time: 0.524343 May 17 18:18:05.312657 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 33/69] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:04 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1278 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:05.319833 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-82acdd58-ab08-4d57-b410-a99bfd12218f req-e67d2dd6-d1bb-466a-b8b3-120f18910e22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e82dfe-21e6-427a-82b1-0b2362423057", "tag": "1740059f-81f9-4984-963e-accf4e584516"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:05.342669 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-82acdd58-ab08-4d57-b410-a99bfd12218f req-e67d2dd6-d1bb-466a-b8b3-120f18910e22 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:05.343348 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-82acdd58-ab08-4d57-b410-a99bfd12218f req-e67d2dd6-d1bb-466a-b8b3-120f18910e22 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:05.400695 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-82acdd58-ab08-4d57-b410-a99bfd12218f req-e67d2dd6-d1bb-466a-b8b3-120f18910e22 service nova] Creating event network-changed:1740059f-81f9-4984-963e-accf4e584516 for instance 01e82dfe-21e6-427a-82b1-0b2362423057 on hv-cinder-83736 May 17 18:18:05.400695 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-82acdd58-ab08-4d57-b410-a99bfd12218f req-e67d2dd6-d1bb-466a-b8b3-120f18910e22 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 17 18:18:05.401147 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-26ff0e28-24e7-427b-bfda-e06810e15ae6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:05.401969 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-26ff0e28-24e7-427b-bfda-e06810e15ae6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:05.404824 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-26ff0e28-24e7-427b-bfda-e06810e15ae6 None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:05.405512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-26ff0e28-24e7-427b-bfda-e06810e15ae6 None None] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:05.420205 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.compute.rpcapi [None req-26ff0e28-24e7-427b-bfda-e06810e15ae6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 17 18:18:05.421364 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-26ff0e28-24e7-427b-bfda-e06810e15ae6 None None] Releasing lock "compute-rpcapi-router" {{(pid=117099) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 17 18:18:05.457347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-26ff0e28-24e7-427b-bfda-e06810e15ae6 None None] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143091 May 17 18:18:05.458526 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 34/70] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:05.464881 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5ef634c9-0054-454b-a59d-faf55d092fd7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:05.465924 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5ef634c9-0054-454b-a59d-faf55d092fd7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:05.472583 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5ef634c9-0054-454b-a59d-faf55d092fd7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:05.486922 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5ef634c9-0054-454b-a59d-faf55d092fd7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:05.487939 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5ef634c9-0054-454b-a59d-faf55d092fd7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:05.494343 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5ef634c9-0054-454b-a59d-faf55d092fd7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.115429 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1043df15-5dfe-4733-b885-f80a6f6579bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:06.137421 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1043df15-5dfe-4733-b885-f80a6f6579bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:06.141316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1043df15-5dfe-4733-b885-f80a6f6579bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:06.142772 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1043df15-5dfe-4733-b885-f80a6f6579bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 1.353179 May 17 18:18:06.143700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 37/71] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:04 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:06.234977 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-e5172c40-2d30-48bb-9e53-13602e41ba1d req-e107349c-6588-410f-ad15-1d6e108f7d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb69ecb4-59b0-447d-86ef-b0cd8ce232b3", "name": "network-vif-plugged", "status": "completed", "tag": "72497b8a-820a-454f-9db2-9a0b38daf150"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:06.244798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-e5172c40-2d30-48bb-9e53-13602e41ba1d req-e107349c-6588-410f-ad15-1d6e108f7d3e service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.245514 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-e5172c40-2d30-48bb-9e53-13602e41ba1d req-e107349c-6588-410f-ad15-1d6e108f7d3e service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.259116 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-e5172c40-2d30-48bb-9e53-13602e41ba1d req-e107349c-6588-410f-ad15-1d6e108f7d3e service nova] Creating event network-vif-plugged:72497b8a-820a-454f-9db2-9a0b38daf150 for instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 on hv-cinder-83736 May 17 18:18:06.266351 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-e5172c40-2d30-48bb-9e53-13602e41ba1d req-e107349c-6588-410f-ad15-1d6e108f7d3e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121448 May 17 18:18:06.267204 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 38/72] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:06.277327 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-90790460-306d-4121-878f-e3491f1d46c6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:06.277991 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-90790460-306d-4121-878f-e3491f1d46c6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:06.284740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90790460-306d-4121-878f-e3491f1d46c6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.285246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90790460-306d-4121-878f-e3491f1d46c6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.286072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90790460-306d-4121-878f-e3491f1d46c6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.286508 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90790460-306d-4121-878f-e3491f1d46c6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.366176 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5ef634c9-0054-454b-a59d-faf55d092fd7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:06.380639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5ef634c9-0054-454b-a59d-faf55d092fd7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.920684 May 17 18:18:06.381282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 35/73] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:05 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:06.386038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c4d8465f-bc9d-45ea-aa78-253fa320e71a tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:06.386660 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c4d8465f-bc9d-45ea-aa78-253fa320e71a tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:06.399134 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4d8465f-bc9d-45ea-aa78-253fa320e71a tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.399791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4d8465f-bc9d-45ea-aa78-253fa320e71a tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.400716 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4d8465f-bc9d-45ea-aa78-253fa320e71a tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.401265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4d8465f-bc9d-45ea-aa78-253fa320e71a tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.700775 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-90790460-306d-4121-878f-e3491f1d46c6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:06.709066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-90790460-306d-4121-878f-e3491f1d46c6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.436861 May 17 18:18:06.709881 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 39/74] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:06 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:06.714223 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2b1bc7da-d5d9-4b5c-9045-716321ff066a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:06.714837 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2b1bc7da-d5d9-4b5c-9045-716321ff066a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:06.727933 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2b1bc7da-d5d9-4b5c-9045-716321ff066a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.728473 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2b1bc7da-d5d9-4b5c-9045-716321ff066a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.729275 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2b1bc7da-d5d9-4b5c-9045-716321ff066a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:06.729923 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2b1bc7da-d5d9-4b5c-9045-716321ff066a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:06.772177 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c4d8465f-bc9d-45ea-aa78-253fa320e71a tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:06.786061 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c4d8465f-bc9d-45ea-aa78-253fa320e71a tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.398430 May 17 18:18:06.798075 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 36/75] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:06 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:07.162709 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-df1a118e-bbd0-4d19-a012-2303cd313d84 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:07.163797 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-df1a118e-bbd0-4d19-a012-2303cd313d84 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:07.175954 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-df1a118e-bbd0-4d19-a012-2303cd313d84 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:07.177664 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-df1a118e-bbd0-4d19-a012-2303cd313d84 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:07.180429 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-df1a118e-bbd0-4d19-a012-2303cd313d84 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:07.182120 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-df1a118e-bbd0-4d19-a012-2303cd313d84 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:07.303731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2b1bc7da-d5d9-4b5c-9045-716321ff066a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:07.319816 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2b1bc7da-d5d9-4b5c-9045-716321ff066a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.609029 May 17 18:18:07.320424 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 40/76] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:06 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:07.421986 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-57538849-170a-4b32-b952-2d8c8780266c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:07.425772 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-57538849-170a-4b32-b952-2d8c8780266c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:07.446002 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-57538849-170a-4b32-b952-2d8c8780266c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:07.446453 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-57538849-170a-4b32-b952-2d8c8780266c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:07.450023 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-57538849-170a-4b32-b952-2d8c8780266c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:07.451268 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-57538849-170a-4b32-b952-2d8c8780266c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:07.554033 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-df1a118e-bbd0-4d19-a012-2303cd313d84 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:07.570319 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-df1a118e-bbd0-4d19-a012-2303cd313d84 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:07.572604 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-df1a118e-bbd0-4d19-a012-2303cd313d84 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:07.574252 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-df1a118e-bbd0-4d19-a012-2303cd313d84 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.415481 May 17 18:18:07.575348 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 37/77] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:07 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:07.907799 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-e5ba3d09-a958-4331-b0e3-9d76d5e84053 req-9d5a1b15-e070-4e08-9e09-5e1524ca0a9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b730dca-866b-4096-9175-6d27c3d35e55", "tag": "d33b9990-24b2-40c1-bba4-2f0d0da36778"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:07.939219 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-e5ba3d09-a958-4331-b0e3-9d76d5e84053 req-9d5a1b15-e070-4e08-9e09-5e1524ca0a9d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:07.940470 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-e5ba3d09-a958-4331-b0e3-9d76d5e84053 req-9d5a1b15-e070-4e08-9e09-5e1524ca0a9d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:07.981858 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-e5ba3d09-a958-4331-b0e3-9d76d5e84053 req-9d5a1b15-e070-4e08-9e09-5e1524ca0a9d service nova] Creating event network-changed:d33b9990-24b2-40c1-bba4-2f0d0da36778 for instance 8b730dca-866b-4096-9175-6d27c3d35e55 on hv-cinder-83736 May 17 18:18:07.988509 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-e5ba3d09-a958-4331-b0e3-9d76d5e84053 req-9d5a1b15-e070-4e08-9e09-5e1524ca0a9d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411644 May 17 18:18:07.989865 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-57538849-170a-4b32-b952-2d8c8780266c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:07.992601 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 38/78] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:07.998458 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-f33b7489-385b-47e0-97f5-d29566548808 req-dceabcdf-e99f-4445-8ff5-74399c7bb650 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e", "tag": "06e106bb-68fb-497b-a3fb-dae45c0c334c"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:08.008799 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-57538849-170a-4b32-b952-2d8c8780266c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.614947 May 17 18:18:08.010607 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 41/79] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:07 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:08.021309 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3d01e867-7c09-435a-9454-dd361e3648f4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:08.022174 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3d01e867-7c09-435a-9454-dd361e3648f4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:08.030098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3d01e867-7c09-435a-9454-dd361e3648f4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.030944 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3d01e867-7c09-435a-9454-dd361e3648f4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.031894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3d01e867-7c09-435a-9454-dd361e3648f4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.032490 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3d01e867-7c09-435a-9454-dd361e3648f4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.040586 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f33b7489-385b-47e0-97f5-d29566548808 req-dceabcdf-e99f-4445-8ff5-74399c7bb650 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.050248 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f33b7489-385b-47e0-97f5-d29566548808 req-dceabcdf-e99f-4445-8ff5-74399c7bb650 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.070199 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-f33b7489-385b-47e0-97f5-d29566548808 req-dceabcdf-e99f-4445-8ff5-74399c7bb650 service nova] Creating event network-changed:06e106bb-68fb-497b-a3fb-dae45c0c334c for instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e on hv-cinder-83736 May 17 18:18:08.082176 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-f33b7489-385b-47e0-97f5-d29566548808 req-dceabcdf-e99f-4445-8ff5-74399c7bb650 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087526 May 17 18:18:08.082940 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 39/80] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:08.089301 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b0502094-6fa1-4daa-9d2f-abf3343691c5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:08.090246 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b0502094-6fa1-4daa-9d2f-abf3343691c5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:08.103512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0502094-6fa1-4daa-9d2f-abf3343691c5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.104216 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0502094-6fa1-4daa-9d2f-abf3343691c5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.105335 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0502094-6fa1-4daa-9d2f-abf3343691c5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.106238 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0502094-6fa1-4daa-9d2f-abf3343691c5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.347630 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3d01e867-7c09-435a-9454-dd361e3648f4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:08.356485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3d01e867-7c09-435a-9454-dd361e3648f4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.344110 May 17 18:18:08.357389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 42/81] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:08 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:08.370211 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-bdc9dc99-6be5-4df5-8129-c8d0eb6f6044 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:08.370921 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-bdc9dc99-6be5-4df5-8129-c8d0eb6f6044 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:08.377250 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bdc9dc99-6be5-4df5-8129-c8d0eb6f6044 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.378047 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bdc9dc99-6be5-4df5-8129-c8d0eb6f6044 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.379136 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bdc9dc99-6be5-4df5-8129-c8d0eb6f6044 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.379567 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bdc9dc99-6be5-4df5-8129-c8d0eb6f6044 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.418571 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b0502094-6fa1-4daa-9d2f-abf3343691c5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:08.426493 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b0502094-6fa1-4daa-9d2f-abf3343691c5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.341990 May 17 18:18:08.427076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 40/82] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:08 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:08.523342 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-bdc9dc99-6be5-4df5-8129-c8d0eb6f6044 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:08.530886 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-bdc9dc99-6be5-4df5-8129-c8d0eb6f6044 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.172305 May 17 18:18:08.531453 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 43/83] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:08 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:08.593345 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0dee4f49-fd9a-47ab-b516-a4b298421706 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:08.594025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0dee4f49-fd9a-47ab-b516-a4b298421706 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:08.601902 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0dee4f49-fd9a-47ab-b516-a4b298421706 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.602366 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0dee4f49-fd9a-47ab-b516-a4b298421706 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.603642 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0dee4f49-fd9a-47ab-b516-a4b298421706 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:08.604093 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0dee4f49-fd9a-47ab-b516-a4b298421706 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:08.734377 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0dee4f49-fd9a-47ab-b516-a4b298421706 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:08.742268 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0dee4f49-fd9a-47ab-b516-a4b298421706 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:08.744345 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0dee4f49-fd9a-47ab-b516-a4b298421706 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:08.745671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0dee4f49-fd9a-47ab-b516-a4b298421706 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.156278 May 17 18:18:08.746231 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 41/84] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:08 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:09.027717 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2c365578-eb61-4ad1-b0c0-2b7a1c77cb39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:09.028336 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2c365578-eb61-4ad1-b0c0-2b7a1c77cb39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:09.034324 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2c365578-eb61-4ad1-b0c0-2b7a1c77cb39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.035062 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2c365578-eb61-4ad1-b0c0-2b7a1c77cb39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.035905 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2c365578-eb61-4ad1-b0c0-2b7a1c77cb39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.036461 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2c365578-eb61-4ad1-b0c0-2b7a1c77cb39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.169306 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2c365578-eb61-4ad1-b0c0-2b7a1c77cb39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:09.176555 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2c365578-eb61-4ad1-b0c0-2b7a1c77cb39 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.153527 May 17 18:18:09.177229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 44/85] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:09 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:09.390202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-adf086a3-66fc-4309-9bb9-27c7fe558000 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:09.391092 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-adf086a3-66fc-4309-9bb9-27c7fe558000 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:09.400657 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-adf086a3-66fc-4309-9bb9-27c7fe558000 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.401768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-adf086a3-66fc-4309-9bb9-27c7fe558000 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.402600 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-adf086a3-66fc-4309-9bb9-27c7fe558000 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.403038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-adf086a3-66fc-4309-9bb9-27c7fe558000 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.443549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9c6144d3-ea98-43d2-aaab-ce14374a3016 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:09.444227 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9c6144d3-ea98-43d2-aaab-ce14374a3016 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:09.451052 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9c6144d3-ea98-43d2-aaab-ce14374a3016 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.451506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9c6144d3-ea98-43d2-aaab-ce14374a3016 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.452354 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9c6144d3-ea98-43d2-aaab-ce14374a3016 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.452796 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9c6144d3-ea98-43d2-aaab-ce14374a3016 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.603111 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-adf086a3-66fc-4309-9bb9-27c7fe558000 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:09.610557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-adf086a3-66fc-4309-9bb9-27c7fe558000 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.233286 May 17 18:18:09.611063 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 42/86] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:09 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:09.615853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5ca2933b-84c5-46ac-9b40-a4cd1fc3e0f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:09.616342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5ca2933b-84c5-46ac-9b40-a4cd1fc3e0f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:09.622694 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5ca2933b-84c5-46ac-9b40-a4cd1fc3e0f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.623155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5ca2933b-84c5-46ac-9b40-a4cd1fc3e0f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.623933 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5ca2933b-84c5-46ac-9b40-a4cd1fc3e0f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.624377 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5ca2933b-84c5-46ac-9b40-a4cd1fc3e0f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.630667 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9c6144d3-ea98-43d2-aaab-ce14374a3016 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:09.638906 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9c6144d3-ea98-43d2-aaab-ce14374a3016 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.199202 May 17 18:18:09.639553 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 45/87] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:09 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:09.751121 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5ca2933b-84c5-46ac-9b40-a4cd1fc3e0f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:09.758331 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5ca2933b-84c5-46ac-9b40-a4cd1fc3e0f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.146332 May 17 18:18:09.758893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 43/88] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:09 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:09.765300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c935465b-dd71-4ebc-b790-9413654d2f2a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:09.766049 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c935465b-dd71-4ebc-b790-9413654d2f2a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:09.772054 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c935465b-dd71-4ebc-b790-9413654d2f2a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.772504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c935465b-dd71-4ebc-b790-9413654d2f2a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.773271 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c935465b-dd71-4ebc-b790-9413654d2f2a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:09.773733 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c935465b-dd71-4ebc-b790-9413654d2f2a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:09.907404 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c935465b-dd71-4ebc-b790-9413654d2f2a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:09.915112 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c935465b-dd71-4ebc-b790-9413654d2f2a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:09.916617 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c935465b-dd71-4ebc-b790-9413654d2f2a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:09.917733 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c935465b-dd71-4ebc-b790-9413654d2f2a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.156277 May 17 18:18:09.918288 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 46/89] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:09 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:10.025740 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-11c123bc-e35c-4760-ba74-4cc268909e0f req-42eb7188-dec1-4dc7-91e6-9cf9dd856f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f92bd0-84e7-4e4f-b596-c73c9453ce85", "tag": "200d9682-a32c-4f1b-afac-5e03e64190d5"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:10.033735 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-11c123bc-e35c-4760-ba74-4cc268909e0f req-42eb7188-dec1-4dc7-91e6-9cf9dd856f15 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.034187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-11c123bc-e35c-4760-ba74-4cc268909e0f req-42eb7188-dec1-4dc7-91e6-9cf9dd856f15 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.044598 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-11c123bc-e35c-4760-ba74-4cc268909e0f req-42eb7188-dec1-4dc7-91e6-9cf9dd856f15 service nova] Creating event network-changed:200d9682-a32c-4f1b-afac-5e03e64190d5 for instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 on hv-cinder-83736 May 17 18:18:10.049389 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-11c123bc-e35c-4760-ba74-4cc268909e0f req-42eb7188-dec1-4dc7-91e6-9cf9dd856f15 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027945 May 17 18:18:10.049985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 44/90] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:10.102694 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-19b50a03-b469-4677-b523-c29da039eb3d req-b403477d-f417-4c44-9d0a-0024149c59df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56e0dba9-a1b6-44ad-af16-8419624a2ba6", "tag": "43a789b0-1ac7-4729-8cc9-8ad941391439"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:10.112552 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-19b50a03-b469-4677-b523-c29da039eb3d req-b403477d-f417-4c44-9d0a-0024149c59df service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.113001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-19b50a03-b469-4677-b523-c29da039eb3d req-b403477d-f417-4c44-9d0a-0024149c59df service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.124823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-19b50a03-b469-4677-b523-c29da039eb3d req-b403477d-f417-4c44-9d0a-0024149c59df service nova] Creating event network-changed:43a789b0-1ac7-4729-8cc9-8ad941391439 for instance 56e0dba9-a1b6-44ad-af16-8419624a2ba6 on hv-cinder-83736 May 17 18:18:10.129633 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-19b50a03-b469-4677-b523-c29da039eb3d req-b403477d-f417-4c44-9d0a-0024149c59df service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031402 May 17 18:18:10.130206 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 47/91] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:10.193974 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d197cd28-3ccb-4d6e-a487-a2370b91a438 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:10.194611 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d197cd28-3ccb-4d6e-a487-a2370b91a438 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:10.201865 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d197cd28-3ccb-4d6e-a487-a2370b91a438 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.202547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d197cd28-3ccb-4d6e-a487-a2370b91a438 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.203620 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d197cd28-3ccb-4d6e-a487-a2370b91a438 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.204150 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d197cd28-3ccb-4d6e-a487-a2370b91a438 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.331222 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d197cd28-3ccb-4d6e-a487-a2370b91a438 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:10.338647 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d197cd28-3ccb-4d6e-a487-a2370b91a438 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.148869 May 17 18:18:10.339194 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 45/92] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:10 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:10.628484 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c1fb8714-f354-48e4-bade-44ba80730f6e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:10.629192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c1fb8714-f354-48e4-bade-44ba80730f6e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:10.636013 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c1fb8714-f354-48e4-bade-44ba80730f6e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.636470 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c1fb8714-f354-48e4-bade-44ba80730f6e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.637232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c1fb8714-f354-48e4-bade-44ba80730f6e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.637780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c1fb8714-f354-48e4-bade-44ba80730f6e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.655812 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0f9e7591-6cca-4530-b2a4-ab150cfe0569 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:10.656422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0f9e7591-6cca-4530-b2a4-ab150cfe0569 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:10.662393 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0f9e7591-6cca-4530-b2a4-ab150cfe0569 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.662841 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0f9e7591-6cca-4530-b2a4-ab150cfe0569 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.663602 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0f9e7591-6cca-4530-b2a4-ab150cfe0569 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.664070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0f9e7591-6cca-4530-b2a4-ab150cfe0569 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.834005 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c1fb8714-f354-48e4-bade-44ba80730f6e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:10.843751 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c1fb8714-f354-48e4-bade-44ba80730f6e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.219447 May 17 18:18:10.844520 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 48/93] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:10 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:10.854063 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0f9e7591-6cca-4530-b2a4-ab150cfe0569 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:10.859093 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b3dfbcba-3675-4034-b9c9-63615b507cdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:10.859708 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b3dfbcba-3675-4034-b9c9-63615b507cdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:10.860348 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0f9e7591-6cca-4530-b2a4-ab150cfe0569 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.208405 May 17 18:18:10.861217 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 46/94] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:10 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:10.870867 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3dfbcba-3675-4034-b9c9-63615b507cdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.871318 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3dfbcba-3675-4034-b9c9-63615b507cdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.872086 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3dfbcba-3675-4034-b9c9-63615b507cdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.872519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3dfbcba-3675-4034-b9c9-63615b507cdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.936366 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-597f1649-a328-42b5-86f8-3e941145d53a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:10.936993 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-597f1649-a328-42b5-86f8-3e941145d53a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:10.942839 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-597f1649-a328-42b5-86f8-3e941145d53a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.943297 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-597f1649-a328-42b5-86f8-3e941145d53a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:10.944072 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-597f1649-a328-42b5-86f8-3e941145d53a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:10.944513 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-597f1649-a328-42b5-86f8-3e941145d53a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.033761 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b3dfbcba-3675-4034-b9c9-63615b507cdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:11.041612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b3dfbcba-3675-4034-b9c9-63615b507cdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.185541 May 17 18:18:11.042181 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 49/95] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:10 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:11.096956 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-597f1649-a328-42b5-86f8-3e941145d53a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:11.105703 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-597f1649-a328-42b5-86f8-3e941145d53a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:11.107206 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-597f1649-a328-42b5-86f8-3e941145d53a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:11.108302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-597f1649-a328-42b5-86f8-3e941145d53a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.176854 May 17 18:18:11.108859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 47/96] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:10 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:11.355961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3a8d31be-6731-402a-998e-8861d8c5272c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:11.356605 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3a8d31be-6731-402a-998e-8861d8c5272c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:11.362632 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3a8d31be-6731-402a-998e-8861d8c5272c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.363126 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3a8d31be-6731-402a-998e-8861d8c5272c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.363883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3a8d31be-6731-402a-998e-8861d8c5272c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.364314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3a8d31be-6731-402a-998e-8861d8c5272c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.493231 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3a8d31be-6731-402a-998e-8861d8c5272c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:11.500426 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3a8d31be-6731-402a-998e-8861d8c5272c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.148889 May 17 18:18:11.500981 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 50/97] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:11 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:11.861631 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-74bcad8a-9e59-4efc-9c5d-c3fe34230777 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:11.862228 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-74bcad8a-9e59-4efc-9c5d-c3fe34230777 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:11.868477 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-74bcad8a-9e59-4efc-9c5d-c3fe34230777 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.868935 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-74bcad8a-9e59-4efc-9c5d-c3fe34230777 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.869724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-74bcad8a-9e59-4efc-9c5d-c3fe34230777 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.870192 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-74bcad8a-9e59-4efc-9c5d-c3fe34230777 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.878047 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f50f07f6-67a6-4ccf-8ac2-d4ae68fe31ef tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:11.878658 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f50f07f6-67a6-4ccf-8ac2-d4ae68fe31ef tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:11.884446 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f50f07f6-67a6-4ccf-8ac2-d4ae68fe31ef tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.884898 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f50f07f6-67a6-4ccf-8ac2-d4ae68fe31ef tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:11.885695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f50f07f6-67a6-4ccf-8ac2-d4ae68fe31ef tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:11.886127 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f50f07f6-67a6-4ccf-8ac2-d4ae68fe31ef tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.044092 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-74bcad8a-9e59-4efc-9c5d-c3fe34230777 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:12.051345 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-74bcad8a-9e59-4efc-9c5d-c3fe34230777 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.193624 May 17 18:18:12.052128 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 48/98] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:11 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:12.058069 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2e1e6771-6ecb-461a-b49c-0c98e011cb01 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:12.058740 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2e1e6771-6ecb-461a-b49c-0c98e011cb01 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:12.064436 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2e1e6771-6ecb-461a-b49c-0c98e011cb01 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.064916 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2e1e6771-6ecb-461a-b49c-0c98e011cb01 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.065727 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2e1e6771-6ecb-461a-b49c-0c98e011cb01 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.066170 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2e1e6771-6ecb-461a-b49c-0c98e011cb01 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.069184 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f50f07f6-67a6-4ccf-8ac2-d4ae68fe31ef tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:12.077171 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f50f07f6-67a6-4ccf-8ac2-d4ae68fe31ef tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.203011 May 17 18:18:12.077782 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 51/99] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:11 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:12.126360 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-09517ecd-b93f-4081-9a7d-6a11fefa10b1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:12.127002 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-09517ecd-b93f-4081-9a7d-6a11fefa10b1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:12.132926 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-09517ecd-b93f-4081-9a7d-6a11fefa10b1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.133499 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-09517ecd-b93f-4081-9a7d-6a11fefa10b1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.134838 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-09517ecd-b93f-4081-9a7d-6a11fefa10b1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.135336 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-09517ecd-b93f-4081-9a7d-6a11fefa10b1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.235319 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2e1e6771-6ecb-461a-b49c-0c98e011cb01 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:12.242833 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2e1e6771-6ecb-461a-b49c-0c98e011cb01 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.188541 May 17 18:18:12.243405 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 49/100] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:12 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:12.278942 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-09517ecd-b93f-4081-9a7d-6a11fefa10b1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:12.286536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-09517ecd-b93f-4081-9a7d-6a11fefa10b1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:12.288036 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-09517ecd-b93f-4081-9a7d-6a11fefa10b1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:12.289129 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-09517ecd-b93f-4081-9a7d-6a11fefa10b1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.166830 May 17 18:18:12.289716 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 52/101] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:12 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:12.516752 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b1ef1c6b-4fea-4bad-a0b0-bebe9cab0eda tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:12.517375 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b1ef1c6b-4fea-4bad-a0b0-bebe9cab0eda tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:12.523965 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b1ef1c6b-4fea-4bad-a0b0-bebe9cab0eda tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.524422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b1ef1c6b-4fea-4bad-a0b0-bebe9cab0eda tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.525273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b1ef1c6b-4fea-4bad-a0b0-bebe9cab0eda tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:12.525885 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b1ef1c6b-4fea-4bad-a0b0-bebe9cab0eda tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:12.658358 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b1ef1c6b-4fea-4bad-a0b0-bebe9cab0eda tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:12.666188 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b1ef1c6b-4fea-4bad-a0b0-bebe9cab0eda tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.153059 May 17 18:18:12.666400 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 50/102] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:12 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:13.067957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cd801d5d-fb7c-4883-9e15-57b4c084057d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:13.068577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cd801d5d-fb7c-4883-9e15-57b4c084057d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:13.075219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd801d5d-fb7c-4883-9e15-57b4c084057d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.075668 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd801d5d-fb7c-4883-9e15-57b4c084057d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.076433 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd801d5d-fb7c-4883-9e15-57b4c084057d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.076871 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd801d5d-fb7c-4883-9e15-57b4c084057d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.093713 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-89edb07a-4467-4852-b8d6-0a6c499a944d tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:13.094334 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-89edb07a-4467-4852-b8d6-0a6c499a944d tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:13.100215 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-89edb07a-4467-4852-b8d6-0a6c499a944d tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.100685 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-89edb07a-4467-4852-b8d6-0a6c499a944d tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.101438 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-89edb07a-4467-4852-b8d6-0a6c499a944d tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.101904 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-89edb07a-4467-4852-b8d6-0a6c499a944d tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.256552 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cd801d5d-fb7c-4883-9e15-57b4c084057d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:13.264788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cd801d5d-fb7c-4883-9e15-57b4c084057d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.200765 May 17 18:18:13.265359 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 53/103] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:13 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:13.269773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-754ae309-7ac2-48bc-b722-f3b406b4e3e7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:13.270500 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-754ae309-7ac2-48bc-b722-f3b406b4e3e7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:13.276244 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-754ae309-7ac2-48bc-b722-f3b406b4e3e7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.276697 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-754ae309-7ac2-48bc-b722-f3b406b4e3e7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.277525 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-754ae309-7ac2-48bc-b722-f3b406b4e3e7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.277965 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-754ae309-7ac2-48bc-b722-f3b406b4e3e7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.278060 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-89edb07a-4467-4852-b8d6-0a6c499a944d tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:13.285265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-89edb07a-4467-4852-b8d6-0a6c499a944d tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.195367 May 17 18:18:13.285954 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 51/104] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:13 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:13.307117 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4d571b8f-83a6-4b9d-91a5-5bc306287623 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:13.307757 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4d571b8f-83a6-4b9d-91a5-5bc306287623 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:13.313780 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4d571b8f-83a6-4b9d-91a5-5bc306287623 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.314260 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4d571b8f-83a6-4b9d-91a5-5bc306287623 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.315029 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4d571b8f-83a6-4b9d-91a5-5bc306287623 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.315464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4d571b8f-83a6-4b9d-91a5-5bc306287623 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.612528 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-754ae309-7ac2-48bc-b722-f3b406b4e3e7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:13.620542 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-754ae309-7ac2-48bc-b722-f3b406b4e3e7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.354187 May 17 18:18:13.621192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 54/105] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:13 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:13.638365 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4d571b8f-83a6-4b9d-91a5-5bc306287623 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:13.645949 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4d571b8f-83a6-4b9d-91a5-5bc306287623 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:13.647443 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4d571b8f-83a6-4b9d-91a5-5bc306287623 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:13.648529 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4d571b8f-83a6-4b9d-91a5-5bc306287623 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.345811 May 17 18:18:13.649080 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 52/106] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:13 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:13.682857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-22e8663b-aa77-4307-91b3-076f047a6207 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:13.683404 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-22e8663b-aa77-4307-91b3-076f047a6207 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:13.689153 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22e8663b-aa77-4307-91b3-076f047a6207 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.689648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22e8663b-aa77-4307-91b3-076f047a6207 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.690437 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22e8663b-aa77-4307-91b3-076f047a6207 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:13.690867 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22e8663b-aa77-4307-91b3-076f047a6207 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:13.820268 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-22e8663b-aa77-4307-91b3-076f047a6207 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:13.828442 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-22e8663b-aa77-4307-91b3-076f047a6207 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.149982 May 17 18:18:13.828994 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 55/107] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:13 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:14.281527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a62733e8-180a-4fcd-a58e-83faf718377c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:14.282085 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a62733e8-180a-4fcd-a58e-83faf718377c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:14.288010 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a62733e8-180a-4fcd-a58e-83faf718377c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.288467 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a62733e8-180a-4fcd-a58e-83faf718377c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.289240 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a62733e8-180a-4fcd-a58e-83faf718377c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.289714 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a62733e8-180a-4fcd-a58e-83faf718377c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.302137 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-708cc6ee-8bca-4fca-84b9-3d06ed8eba4c tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:14.302758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-708cc6ee-8bca-4fca-84b9-3d06ed8eba4c tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:14.309032 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-708cc6ee-8bca-4fca-84b9-3d06ed8eba4c tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.309507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-708cc6ee-8bca-4fca-84b9-3d06ed8eba4c tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.310282 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-708cc6ee-8bca-4fca-84b9-3d06ed8eba4c tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.310722 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-708cc6ee-8bca-4fca-84b9-3d06ed8eba4c tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.477167 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a62733e8-180a-4fcd-a58e-83faf718377c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:14.484835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a62733e8-180a-4fcd-a58e-83faf718377c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.207223 May 17 18:18:14.485474 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 53/108] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:14 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:14.490818 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-708cc6ee-8bca-4fca-84b9-3d06ed8eba4c tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:14.500161 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-708cc6ee-8bca-4fca-84b9-3d06ed8eba4c tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.201792 May 17 18:18:14.500733 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 56/109] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:14 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:14.638996 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a5e7ff71-fa01-415c-b04a-d51f3cb0f54e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:14.639605 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a5e7ff71-fa01-415c-b04a-d51f3cb0f54e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:14.645483 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a5e7ff71-fa01-415c-b04a-d51f3cb0f54e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.645932 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a5e7ff71-fa01-415c-b04a-d51f3cb0f54e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.646685 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a5e7ff71-fa01-415c-b04a-d51f3cb0f54e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.647124 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a5e7ff71-fa01-415c-b04a-d51f3cb0f54e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.666476 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-20c3b549-796d-4110-9b82-e2a9b00e1ed4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:14.667085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-20c3b549-796d-4110-9b82-e2a9b00e1ed4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:14.672943 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20c3b549-796d-4110-9b82-e2a9b00e1ed4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.673390 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20c3b549-796d-4110-9b82-e2a9b00e1ed4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.674179 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20c3b549-796d-4110-9b82-e2a9b00e1ed4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.674615 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20c3b549-796d-4110-9b82-e2a9b00e1ed4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.833220 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a5e7ff71-fa01-415c-b04a-d51f3cb0f54e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:14.841687 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a5e7ff71-fa01-415c-b04a-d51f3cb0f54e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.207141 May 17 18:18:14.842488 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 54/110] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:14 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:14.851994 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-20c3b549-796d-4110-9b82-e2a9b00e1ed4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:14.856026 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-bc78fb25-569f-458c-9f5a-6c2e36552314 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:14.856644 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-bc78fb25-569f-458c-9f5a-6c2e36552314 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:14.862323 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-20c3b549-796d-4110-9b82-e2a9b00e1ed4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:14.862635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc78fb25-569f-458c-9f5a-6c2e36552314 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.863089 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc78fb25-569f-458c-9f5a-6c2e36552314 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.863866 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc78fb25-569f-458c-9f5a-6c2e36552314 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:14.863967 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-20c3b549-796d-4110-9b82-e2a9b00e1ed4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:14.864301 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc78fb25-569f-458c-9f5a-6c2e36552314 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:14.864992 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-20c3b549-796d-4110-9b82-e2a9b00e1ed4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.202341 May 17 18:18:14.875701 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 57/111] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:14 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:14.991305 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bc78fb25-569f-458c-9f5a-6c2e36552314 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:14.999079 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-bc78fb25-569f-458c-9f5a-6c2e36552314 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.155608 May 17 18:18:14.999636 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 55/112] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:14 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:15.501538 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-85e3b628-75f2-414f-9d6d-118292149c58 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:15.502149 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-85e3b628-75f2-414f-9d6d-118292149c58 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:15.508022 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-85e3b628-75f2-414f-9d6d-118292149c58 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:15.508474 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-85e3b628-75f2-414f-9d6d-118292149c58 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:15.509264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-85e3b628-75f2-414f-9d6d-118292149c58 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:15.509728 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-85e3b628-75f2-414f-9d6d-118292149c58 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:15.517603 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2607269a-d31a-42aa-9c96-ba2c18fc4309 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:15.518253 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2607269a-d31a-42aa-9c96-ba2c18fc4309 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:15.524113 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2607269a-d31a-42aa-9c96-ba2c18fc4309 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:15.524566 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2607269a-d31a-42aa-9c96-ba2c18fc4309 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:15.525857 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2607269a-d31a-42aa-9c96-ba2c18fc4309 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:15.526293 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2607269a-d31a-42aa-9c96-ba2c18fc4309 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:15.703246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-85e3b628-75f2-414f-9d6d-118292149c58 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:15.710508 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-85e3b628-75f2-414f-9d6d-118292149c58 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.212744 May 17 18:18:15.711074 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 58/113] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:15 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:15.714713 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2607269a-d31a-42aa-9c96-ba2c18fc4309 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:15.722107 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2607269a-d31a-42aa-9c96-ba2c18fc4309 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.208454 May 17 18:18:15.722655 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 56/114] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:15 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:15.858824 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2a8b682d-5922-4ad1-8484-7ba5ac1fce21 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:15.859447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2a8b682d-5922-4ad1-8484-7ba5ac1fce21 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:15.865637 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a8b682d-5922-4ad1-8484-7ba5ac1fce21 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:15.866096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a8b682d-5922-4ad1-8484-7ba5ac1fce21 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:15.866899 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a8b682d-5922-4ad1-8484-7ba5ac1fce21 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:15.867345 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a8b682d-5922-4ad1-8484-7ba5ac1fce21 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:15.883195 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f0a09504-2453-4abc-ae5b-d5f5222607d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:15.883809 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f0a09504-2453-4abc-ae5b-d5f5222607d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:15.890427 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f0a09504-2453-4abc-ae5b-d5f5222607d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:15.890889 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f0a09504-2453-4abc-ae5b-d5f5222607d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:15.891666 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f0a09504-2453-4abc-ae5b-d5f5222607d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:15.892107 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f0a09504-2453-4abc-ae5b-d5f5222607d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.065876 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2a8b682d-5922-4ad1-8484-7ba5ac1fce21 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:16.073969 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f0a09504-2453-4abc-ae5b-d5f5222607d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:16.074416 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2a8b682d-5922-4ad1-8484-7ba5ac1fce21 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.219464 May 17 18:18:16.075211 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 59/115] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:15 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:16.079835 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ec404bc3-43e7-42af-a022-16149cd56e56 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:16.080451 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ec404bc3-43e7-42af-a022-16149cd56e56 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:16.081952 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f0a09504-2453-4abc-ae5b-d5f5222607d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:16.083435 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f0a09504-2453-4abc-ae5b-d5f5222607d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:16.084550 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f0a09504-2453-4abc-ae5b-d5f5222607d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.205222 May 17 18:18:16.089564 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 57/116] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:15 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:16.089681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ec404bc3-43e7-42af-a022-16149cd56e56 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.089681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ec404bc3-43e7-42af-a022-16149cd56e56 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.089681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ec404bc3-43e7-42af-a022-16149cd56e56 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.089681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ec404bc3-43e7-42af-a022-16149cd56e56 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.218898 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ec404bc3-43e7-42af-a022-16149cd56e56 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:16.226644 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ec404bc3-43e7-42af-a022-16149cd56e56 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.150654 May 17 18:18:16.227365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 60/117] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:16 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:16.728419 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ce691a89-5819-4094-a213-fae07937ee24 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:16.729044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ce691a89-5819-4094-a213-fae07937ee24 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:16.738257 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ce691a89-5819-4094-a213-fae07937ee24 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.739040 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ce691a89-5819-4094-a213-fae07937ee24 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.740154 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-99f17ab9-ea29-415e-a3af-c31cd4e3d785 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:16.741161 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-99f17ab9-ea29-415e-a3af-c31cd4e3d785 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:16.741571 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ce691a89-5819-4094-a213-fae07937ee24 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.742200 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ce691a89-5819-4094-a213-fae07937ee24 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.756436 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-99f17ab9-ea29-415e-a3af-c31cd4e3d785 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.756436 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-99f17ab9-ea29-415e-a3af-c31cd4e3d785 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.756436 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-99f17ab9-ea29-415e-a3af-c31cd4e3d785 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:16.756436 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-99f17ab9-ea29-415e-a3af-c31cd4e3d785 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:16.972831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ce691a89-5819-4094-a213-fae07937ee24 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:16.984503 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ce691a89-5819-4094-a213-fae07937ee24 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.260305 May 17 18:18:16.985654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 58/118] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:16 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:17.001242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-99f17ab9-ea29-415e-a3af-c31cd4e3d785 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:17.010813 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-99f17ab9-ea29-415e-a3af-c31cd4e3d785 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.275042 May 17 18:18:17.012448 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 61/119] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:16 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:17.091128 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7dfc2304-7f71-460c-a908-764b18279494 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:17.091779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7dfc2304-7f71-460c-a908-764b18279494 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:17.098070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7dfc2304-7f71-460c-a908-764b18279494 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.098530 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7dfc2304-7f71-460c-a908-764b18279494 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.099302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7dfc2304-7f71-460c-a908-764b18279494 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.099742 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7dfc2304-7f71-460c-a908-764b18279494 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.102511 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3a3e9ffb-2c8b-4812-a6ef-1db4845bad5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:17.103148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3a3e9ffb-2c8b-4812-a6ef-1db4845bad5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:17.108904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3a3e9ffb-2c8b-4812-a6ef-1db4845bad5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.109354 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3a3e9ffb-2c8b-4812-a6ef-1db4845bad5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.110158 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3a3e9ffb-2c8b-4812-a6ef-1db4845bad5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.110594 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3a3e9ffb-2c8b-4812-a6ef-1db4845bad5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.783325 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3a3e9ffb-2c8b-4812-a6ef-1db4845bad5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:17.791972 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3a3e9ffb-2c8b-4812-a6ef-1db4845bad5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:17.793489 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3a3e9ffb-2c8b-4812-a6ef-1db4845bad5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:17.805159 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3a3e9ffb-2c8b-4812-a6ef-1db4845bad5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.706322 May 17 18:18:17.816180 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 62/120] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:17 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:17.829376 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9d748f86-66c0-47f4-9bd4-ba89bca79190 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:17.830382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9d748f86-66c0-47f4-9bd4-ba89bca79190 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:17.858234 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9d748f86-66c0-47f4-9bd4-ba89bca79190 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.862958 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9d748f86-66c0-47f4-9bd4-ba89bca79190 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.864032 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9d748f86-66c0-47f4-9bd4-ba89bca79190 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:17.864658 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9d748f86-66c0-47f4-9bd4-ba89bca79190 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:17.885512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7dfc2304-7f71-460c-a908-764b18279494 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:17.897610 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7dfc2304-7f71-460c-a908-764b18279494 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.809792 May 17 18:18:17.899327 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 59/121] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:17 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:18.002676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e421cdee-9a6b-4f52-ae0b-9d42c55a6d8d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:18.003465 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e421cdee-9a6b-4f52-ae0b-9d42c55a6d8d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:18.010556 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e421cdee-9a6b-4f52-ae0b-9d42c55a6d8d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.011897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e421cdee-9a6b-4f52-ae0b-9d42c55a6d8d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.012911 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e421cdee-9a6b-4f52-ae0b-9d42c55a6d8d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.013579 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e421cdee-9a6b-4f52-ae0b-9d42c55a6d8d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.460961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9d748f86-66c0-47f4-9bd4-ba89bca79190 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:18.467915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e421cdee-9a6b-4f52-ae0b-9d42c55a6d8d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:18.474440 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9d748f86-66c0-47f4-9bd4-ba89bca79190 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.656921 May 17 18:18:18.475314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 63/122] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:17 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:18.477608 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e421cdee-9a6b-4f52-ae0b-9d42c55a6d8d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.479399 May 17 18:18:18.478684 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 60/123] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:17 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:18.481595 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fc6c7a84-0f58-44c8-a8b5-72fc0a775ded tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:18.482357 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fc6c7a84-0f58-44c8-a8b5-72fc0a775ded tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:18.488486 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fc6c7a84-0f58-44c8-a8b5-72fc0a775ded tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.489015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fc6c7a84-0f58-44c8-a8b5-72fc0a775ded tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.490051 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fc6c7a84-0f58-44c8-a8b5-72fc0a775ded tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.490578 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fc6c7a84-0f58-44c8-a8b5-72fc0a775ded tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.687057 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fc6c7a84-0f58-44c8-a8b5-72fc0a775ded tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:18.699515 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fc6c7a84-0f58-44c8-a8b5-72fc0a775ded tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1315 microversion: 2.1 time: 0.222872 May 17 18:18:18.720976 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 64/124] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:18 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:18.824190 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2560b327-ed09-49a0-b08e-8a05bfaffdce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:18.825109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2560b327-ed09-49a0-b08e-8a05bfaffdce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:18.833821 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2560b327-ed09-49a0-b08e-8a05bfaffdce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.837028 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2560b327-ed09-49a0-b08e-8a05bfaffdce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.838730 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2560b327-ed09-49a0-b08e-8a05bfaffdce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.841417 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2560b327-ed09-49a0-b08e-8a05bfaffdce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.918078 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ad99cf08-fad2-42e5-ac9c-a122088a68f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:18.919373 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ad99cf08-fad2-42e5-ac9c-a122088a68f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:18.945734 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad99cf08-fad2-42e5-ac9c-a122088a68f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.949907 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad99cf08-fad2-42e5-ac9c-a122088a68f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:18.950219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad99cf08-fad2-42e5-ac9c-a122088a68f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:18.954808 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad99cf08-fad2-42e5-ac9c-a122088a68f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:19.329323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2560b327-ed09-49a0-b08e-8a05bfaffdce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:19.337265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2560b327-ed09-49a0-b08e-8a05bfaffdce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:19.338800 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2560b327-ed09-49a0-b08e-8a05bfaffdce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:19.339915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2560b327-ed09-49a0-b08e-8a05bfaffdce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.520492 May 17 18:18:19.340724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 61/125] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:18 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:19.357031 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-cf4d02c2-e4e8-4c8a-a822-69ead14d7fa3 req-71f49ff8-0d4a-4897-b69e-b3fac481a917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e82dfe-21e6-427a-82b1-0b2362423057", "name": "network-vif-plugged", "status": "completed", "tag": "1740059f-81f9-4984-963e-accf4e584516"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:19.371799 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-cf4d02c2-e4e8-4c8a-a822-69ead14d7fa3 req-71f49ff8-0d4a-4897-b69e-b3fac481a917 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:19.372227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-cf4d02c2-e4e8-4c8a-a822-69ead14d7fa3 req-71f49ff8-0d4a-4897-b69e-b3fac481a917 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:19.385789 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-cf4d02c2-e4e8-4c8a-a822-69ead14d7fa3 req-71f49ff8-0d4a-4897-b69e-b3fac481a917 service nova] Creating event network-vif-plugged:1740059f-81f9-4984-963e-accf4e584516 for instance 01e82dfe-21e6-427a-82b1-0b2362423057 on hv-cinder-83736 May 17 18:18:19.390864 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-cf4d02c2-e4e8-4c8a-a822-69ead14d7fa3 req-71f49ff8-0d4a-4897-b69e-b3fac481a917 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049297 May 17 18:18:19.391620 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 62/126] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:19.495307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-70d096f4-b568-4fa9-9110-688a8b34078c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:19.496075 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-70d096f4-b568-4fa9-9110-688a8b34078c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:19.514896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-70d096f4-b568-4fa9-9110-688a8b34078c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:19.516262 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-70d096f4-b568-4fa9-9110-688a8b34078c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:19.524630 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-70d096f4-b568-4fa9-9110-688a8b34078c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:19.535875 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-70d096f4-b568-4fa9-9110-688a8b34078c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:19.624327 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ad99cf08-fad2-42e5-ac9c-a122088a68f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:19.633496 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ad99cf08-fad2-42e5-ac9c-a122088a68f8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.720790 May 17 18:18:19.634051 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 65/127] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:18 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:19.646859 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4b48ac20-3752-4539-9842-ba0344d9f05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:19.647986 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4b48ac20-3752-4539-9842-ba0344d9f05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:19.660053 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4b48ac20-3752-4539-9842-ba0344d9f05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:19.660509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4b48ac20-3752-4539-9842-ba0344d9f05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:19.661290 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4b48ac20-3752-4539-9842-ba0344d9f05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:19.661767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4b48ac20-3752-4539-9842-ba0344d9f05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.112074 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-70d096f4-b568-4fa9-9110-688a8b34078c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:20.120545 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-70d096f4-b568-4fa9-9110-688a8b34078c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.632171 May 17 18:18:20.121859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 63/128] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:19 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:20.126674 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-fa1eb18e-71ee-4d14-9846-76424c47a0f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:20.127311 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-fa1eb18e-71ee-4d14-9846-76424c47a0f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:20.133680 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fa1eb18e-71ee-4d14-9846-76424c47a0f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:20.134639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fa1eb18e-71ee-4d14-9846-76424c47a0f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.135444 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fa1eb18e-71ee-4d14-9846-76424c47a0f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:20.135892 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fa1eb18e-71ee-4d14-9846-76424c47a0f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.142662 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4b48ac20-3752-4539-9842-ba0344d9f05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:20.150464 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4b48ac20-3752-4539-9842-ba0344d9f05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.509985 May 17 18:18:20.151110 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 66/129] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:19 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:20.326786 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-fa1eb18e-71ee-4d14-9846-76424c47a0f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:20.334730 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-fa1eb18e-71ee-4d14-9846-76424c47a0f0 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1501 microversion: 2.1 time: 0.211675 May 17 18:18:20.335389 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 64/130] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:20 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1501 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:20.358596 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-984857d0-41ab-4f0f-9cf6-e8131622aa38 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:20.359241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-984857d0-41ab-4f0f-9cf6-e8131622aa38 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:20.365971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-984857d0-41ab-4f0f-9cf6-e8131622aa38 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:20.366883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-984857d0-41ab-4f0f-9cf6-e8131622aa38 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.368136 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-984857d0-41ab-4f0f-9cf6-e8131622aa38 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:20.369305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-984857d0-41ab-4f0f-9cf6-e8131622aa38 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.548091 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-984857d0-41ab-4f0f-9cf6-e8131622aa38 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:20.559696 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-984857d0-41ab-4f0f-9cf6-e8131622aa38 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:20.562137 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-984857d0-41ab-4f0f-9cf6-e8131622aa38 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:20.563344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-984857d0-41ab-4f0f-9cf6-e8131622aa38 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.209267 May 17 18:18:20.563885 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 67/131] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:20 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:20.651244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-235a6de0-fecb-41c5-9149-b1aad2d23efe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:20.652142 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-235a6de0-fecb-41c5-9149-b1aad2d23efe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:20.658750 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-235a6de0-fecb-41c5-9149-b1aad2d23efe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:20.659280 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-235a6de0-fecb-41c5-9149-b1aad2d23efe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.660186 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-235a6de0-fecb-41c5-9149-b1aad2d23efe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:20.660844 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-235a6de0-fecb-41c5-9149-b1aad2d23efe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:20.821482 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-235a6de0-fecb-41c5-9149-b1aad2d23efe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:20.830751 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-235a6de0-fecb-41c5-9149-b1aad2d23efe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.184237 May 17 18:18:20.844839 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 65/132] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:20 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:21.139972 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ad296e27-3c5f-4f22-9709-f1a38dc2eb9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:21.140853 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ad296e27-3c5f-4f22-9709-f1a38dc2eb9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:21.153665 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad296e27-3c5f-4f22-9709-f1a38dc2eb9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.154806 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad296e27-3c5f-4f22-9709-f1a38dc2eb9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.156575 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad296e27-3c5f-4f22-9709-f1a38dc2eb9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.157056 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad296e27-3c5f-4f22-9709-f1a38dc2eb9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.172640 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f641a3c3-cc88-4bec-861f-fd7f1618c020 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:21.174515 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f641a3c3-cc88-4bec-861f-fd7f1618c020 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:21.190944 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f641a3c3-cc88-4bec-861f-fd7f1618c020 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.191405 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f641a3c3-cc88-4bec-861f-fd7f1618c020 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.199737 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f641a3c3-cc88-4bec-861f-fd7f1618c020 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.201737 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f641a3c3-cc88-4bec-861f-fd7f1618c020 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.375930 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ad296e27-3c5f-4f22-9709-f1a38dc2eb9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:21.392291 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ad296e27-3c5f-4f22-9709-f1a38dc2eb9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.256738 May 17 18:18:21.392885 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 68/133] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:21 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:21.448768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f641a3c3-cc88-4bec-861f-fd7f1618c020 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:21.456564 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f641a3c3-cc88-4bec-861f-fd7f1618c020 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.291585 May 17 18:18:21.457785 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 66/134] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:21 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:21.581747 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-66cd6877-3b8c-4f59-a5f6-b550f556babf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:21.582462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-66cd6877-3b8c-4f59-a5f6-b550f556babf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:21.589265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-66cd6877-3b8c-4f59-a5f6-b550f556babf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.589916 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-66cd6877-3b8c-4f59-a5f6-b550f556babf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.590688 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-66cd6877-3b8c-4f59-a5f6-b550f556babf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.591358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-66cd6877-3b8c-4f59-a5f6-b550f556babf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.757182 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-66cd6877-3b8c-4f59-a5f6-b550f556babf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:21.767599 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-66cd6877-3b8c-4f59-a5f6-b550f556babf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:21.769624 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-66cd6877-3b8c-4f59-a5f6-b550f556babf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:21.770979 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-66cd6877-3b8c-4f59-a5f6-b550f556babf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.193451 May 17 18:18:21.772184 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 69/135] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:21 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:21.791551 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ca38a011-c629-4868-ad95-ae9e7c11bdd8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb8063a7-cf5d-4b26-8cf9-804a800a3023"}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:21.792672 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ca38a011-c629-4868-ad95-ae9e7c11bdd8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:21.798604 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ca38a011-c629-4868-ad95-ae9e7c11bdd8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.799049 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ca38a011-c629-4868-ad95-ae9e7c11bdd8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.799814 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ca38a011-c629-4868-ad95-ae9e7c11bdd8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.800245 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ca38a011-c629-4868-ad95-ae9e7c11bdd8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.852163 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-50e42e2f-1e75-4f9d-a6ef-2b0a6911e3cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:21.853354 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-50e42e2f-1e75-4f9d-a6ef-2b0a6911e3cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:21.863401 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-50e42e2f-1e75-4f9d-a6ef-2b0a6911e3cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.863955 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-50e42e2f-1e75-4f9d-a6ef-2b0a6911e3cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:21.864883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-50e42e2f-1e75-4f9d-a6ef-2b0a6911e3cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:21.865643 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-50e42e2f-1e75-4f9d-a6ef-2b0a6911e3cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.051410 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-50e42e2f-1e75-4f9d-a6ef-2b0a6911e3cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:22.059563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-50e42e2f-1e75-4f9d-a6ef-2b0a6911e3cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.214000 May 17 18:18:22.060128 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 70/136] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:21 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:22.411851 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-750b86f0-12d7-4725-88b5-1a3ab625ff54 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:22.412655 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-750b86f0-12d7-4725-88b5-1a3ab625ff54 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:22.422004 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-750b86f0-12d7-4725-88b5-1a3ab625ff54 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.423454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-750b86f0-12d7-4725-88b5-1a3ab625ff54 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.424608 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-750b86f0-12d7-4725-88b5-1a3ab625ff54 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.425042 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-750b86f0-12d7-4725-88b5-1a3ab625ff54 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.726963 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-750b86f0-12d7-4725-88b5-1a3ab625ff54 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:22.735434 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-750b86f0-12d7-4725-88b5-1a3ab625ff54 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.329525 May 17 18:18:22.735998 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 71/137] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:22 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:22.740844 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-151d0df5-ea07-4c9d-9e40-1b3dd1d63218 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:22.741588 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-151d0df5-ea07-4c9d-9e40-1b3dd1d63218 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:22.748624 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-151d0df5-ea07-4c9d-9e40-1b3dd1d63218 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.749074 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-151d0df5-ea07-4c9d-9e40-1b3dd1d63218 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.749896 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-151d0df5-ea07-4c9d-9e40-1b3dd1d63218 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.750298 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-151d0df5-ea07-4c9d-9e40-1b3dd1d63218 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.877834 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-151d0df5-ea07-4c9d-9e40-1b3dd1d63218 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:22.885571 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-151d0df5-ea07-4c9d-9e40-1b3dd1d63218 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.148411 May 17 18:18:22.886142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 72/138] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:22 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:22.890555 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-93cc721f-11ae-44f4-8d3a-1a94c94be3a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:22.891161 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-93cc721f-11ae-44f4-8d3a-1a94c94be3a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:22.896997 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-93cc721f-11ae-44f4-8d3a-1a94c94be3a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.897452 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-93cc721f-11ae-44f4-8d3a-1a94c94be3a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:22.898264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-93cc721f-11ae-44f4-8d3a-1a94c94be3a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:22.898701 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-93cc721f-11ae-44f4-8d3a-1a94c94be3a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:23.030020 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-93cc721f-11ae-44f4-8d3a-1a94c94be3a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:23.038132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-93cc721f-11ae-44f4-8d3a-1a94c94be3a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:23.039674 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-93cc721f-11ae-44f4-8d3a-1a94c94be3a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:23.041447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-93cc721f-11ae-44f4-8d3a-1a94c94be3a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.154386 May 17 18:18:23.042035 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 73/139] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:22 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:23.076247 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a05c8cc8-1aac-4df1-871f-ca077e14ea62 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:23.076866 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a05c8cc8-1aac-4df1-871f-ca077e14ea62 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:23.082720 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a05c8cc8-1aac-4df1-871f-ca077e14ea62 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:23.083166 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a05c8cc8-1aac-4df1-871f-ca077e14ea62 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:23.083935 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a05c8cc8-1aac-4df1-871f-ca077e14ea62 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:23.084369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a05c8cc8-1aac-4df1-871f-ca077e14ea62 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:23.216601 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a05c8cc8-1aac-4df1-871f-ca077e14ea62 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:23.228825 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a05c8cc8-1aac-4df1-871f-ca077e14ea62 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.156483 May 17 18:18:23.229398 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 74/140] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:23 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:23.751930 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-31f65132-81fb-46d6-a283-209e261bb741 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:23.752540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-31f65132-81fb-46d6-a283-209e261bb741 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:23.760114 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-31f65132-81fb-46d6-a283-209e261bb741 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:23.760574 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-31f65132-81fb-46d6-a283-209e261bb741 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:23.761361 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-31f65132-81fb-46d6-a283-209e261bb741 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:23.761842 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-31f65132-81fb-46d6-a283-209e261bb741 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:23.892911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-31f65132-81fb-46d6-a283-209e261bb741 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:23.900994 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-31f65132-81fb-46d6-a283-209e261bb741 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.152815 May 17 18:18:23.901586 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 75/141] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:23 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:23.905934 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9a76f37f-7ad0-4edb-9c05-a2fbe737d2ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:23.906587 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9a76f37f-7ad0-4edb-9c05-a2fbe737d2ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:23.912149 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9a76f37f-7ad0-4edb-9c05-a2fbe737d2ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:23.912602 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9a76f37f-7ad0-4edb-9c05-a2fbe737d2ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:23.913374 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9a76f37f-7ad0-4edb-9c05-a2fbe737d2ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:23.913836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9a76f37f-7ad0-4edb-9c05-a2fbe737d2ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:24.046589 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9a76f37f-7ad0-4edb-9c05-a2fbe737d2ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:24.053922 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9a76f37f-7ad0-4edb-9c05-a2fbe737d2ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.151341 May 17 18:18:24.054496 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 76/142] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:23 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:24.058963 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-acac1cea-a31e-46fe-979f-1a14a563484b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:24.059598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-acac1cea-a31e-46fe-979f-1a14a563484b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:24.068010 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-acac1cea-a31e-46fe-979f-1a14a563484b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:24.068459 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-acac1cea-a31e-46fe-979f-1a14a563484b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:24.069228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-acac1cea-a31e-46fe-979f-1a14a563484b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:24.069702 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-acac1cea-a31e-46fe-979f-1a14a563484b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:24.375034 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-acac1cea-a31e-46fe-979f-1a14a563484b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:24.383061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-acac1cea-a31e-46fe-979f-1a14a563484b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:24.385073 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-acac1cea-a31e-46fe-979f-1a14a563484b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:24.386319 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-acac1cea-a31e-46fe-979f-1a14a563484b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.330860 May 17 18:18:24.386867 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 77/143] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:24 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:24.394638 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-17f1a6a6-872e-493a-990e-7c3b157af372 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:24.395255 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-17f1a6a6-872e-493a-990e-7c3b157af372 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:24.401762 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-17f1a6a6-872e-493a-990e-7c3b157af372 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:24.402272 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-17f1a6a6-872e-493a-990e-7c3b157af372 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:24.403052 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-17f1a6a6-872e-493a-990e-7c3b157af372 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:24.403494 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-17f1a6a6-872e-493a-990e-7c3b157af372 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:24.529855 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-17f1a6a6-872e-493a-990e-7c3b157af372 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:24.538563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-17f1a6a6-872e-493a-990e-7c3b157af372 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.148094 May 17 18:18:24.539217 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 78/144] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:24 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:24.918296 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-660ededf-30e0-4d5b-ae44-0f4fd5762c8e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:24.919985 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-660ededf-30e0-4d5b-ae44-0f4fd5762c8e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:24.926539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-660ededf-30e0-4d5b-ae44-0f4fd5762c8e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:24.927171 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-660ededf-30e0-4d5b-ae44-0f4fd5762c8e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:24.928085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-660ededf-30e0-4d5b-ae44-0f4fd5762c8e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:24.928532 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-660ededf-30e0-4d5b-ae44-0f4fd5762c8e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.075345 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-660ededf-30e0-4d5b-ae44-0f4fd5762c8e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:25.082983 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-660ededf-30e0-4d5b-ae44-0f4fd5762c8e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.168884 May 17 18:18:25.083557 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 79/145] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:24 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:25.096348 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d446cb82-b467-49ce-b894-b1c50dcf90ab tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:25.096964 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d446cb82-b467-49ce-b894-b1c50dcf90ab tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:25.103302 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d446cb82-b467-49ce-b894-b1c50dcf90ab tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.103744 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d446cb82-b467-49ce-b894-b1c50dcf90ab tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.104678 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d446cb82-b467-49ce-b894-b1c50dcf90ab tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.105113 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d446cb82-b467-49ce-b894-b1c50dcf90ab tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.237875 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d446cb82-b467-49ce-b894-b1c50dcf90ab tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:25.246363 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d446cb82-b467-49ce-b894-b1c50dcf90ab tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.161551 May 17 18:18:25.246954 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 80/146] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:25 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:25.404398 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ede025f6-da0f-4c50-999f-0f49c11480ed tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:25.405016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ede025f6-da0f-4c50-999f-0f49c11480ed tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:25.410806 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ede025f6-da0f-4c50-999f-0f49c11480ed tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.411255 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ede025f6-da0f-4c50-999f-0f49c11480ed tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.412016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ede025f6-da0f-4c50-999f-0f49c11480ed tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.412452 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ede025f6-da0f-4c50-999f-0f49c11480ed tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.540728 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ede025f6-da0f-4c50-999f-0f49c11480ed tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:25.549243 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ede025f6-da0f-4c50-999f-0f49c11480ed tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:25.550840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ede025f6-da0f-4c50-999f-0f49c11480ed tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:25.551988 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ede025f6-da0f-4c50-999f-0f49c11480ed tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.151430 May 17 18:18:25.561863 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 81/147] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:25 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:25.561863 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b32f09c6-709c-4d91-b3f2-fc22f8d01101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:25.561863 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b32f09c6-709c-4d91-b3f2-fc22f8d01101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:25.566554 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b32f09c6-709c-4d91-b3f2-fc22f8d01101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.567199 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b32f09c6-709c-4d91-b3f2-fc22f8d01101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.567973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b32f09c6-709c-4d91-b3f2-fc22f8d01101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:25.568405 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b32f09c6-709c-4d91-b3f2-fc22f8d01101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:25.707385 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b32f09c6-709c-4d91-b3f2-fc22f8d01101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:25.715662 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b32f09c6-709c-4d91-b3f2-fc22f8d01101 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.162127 May 17 18:18:25.716219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 82/148] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:25 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:26.100241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c01ee147-238e-4cd7-ab35-7de7d0096a65 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:26.100874 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c01ee147-238e-4cd7-ab35-7de7d0096a65 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:26.107266 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c01ee147-238e-4cd7-ab35-7de7d0096a65 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.107716 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c01ee147-238e-4cd7-ab35-7de7d0096a65 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.108476 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c01ee147-238e-4cd7-ab35-7de7d0096a65 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.108912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c01ee147-238e-4cd7-ab35-7de7d0096a65 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.244398 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c01ee147-238e-4cd7-ab35-7de7d0096a65 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:26.253926 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c01ee147-238e-4cd7-ab35-7de7d0096a65 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.157315 May 17 18:18:26.254482 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 83/149] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:26 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:26.263900 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6458c4cb-c1be-4de8-8f36-6ca5216f1453 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:26.264619 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6458c4cb-c1be-4de8-8f36-6ca5216f1453 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:26.271021 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6458c4cb-c1be-4de8-8f36-6ca5216f1453 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.271469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6458c4cb-c1be-4de8-8f36-6ca5216f1453 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.272236 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6458c4cb-c1be-4de8-8f36-6ca5216f1453 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.272699 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6458c4cb-c1be-4de8-8f36-6ca5216f1453 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.402680 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6458c4cb-c1be-4de8-8f36-6ca5216f1453 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:26.410089 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6458c4cb-c1be-4de8-8f36-6ca5216f1453 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.150265 May 17 18:18:26.410658 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 84/150] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:26 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:26.574869 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cd98b5b5-34f2-4807-aec9-2785ee83b0ae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:26.575480 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cd98b5b5-34f2-4807-aec9-2785ee83b0ae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:26.581608 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd98b5b5-34f2-4807-aec9-2785ee83b0ae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.582069 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd98b5b5-34f2-4807-aec9-2785ee83b0ae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.583003 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd98b5b5-34f2-4807-aec9-2785ee83b0ae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.583437 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd98b5b5-34f2-4807-aec9-2785ee83b0ae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.716933 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cd98b5b5-34f2-4807-aec9-2785ee83b0ae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:26.727067 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cd98b5b5-34f2-4807-aec9-2785ee83b0ae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:26.729158 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cd98b5b5-34f2-4807-aec9-2785ee83b0ae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:26.730595 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cd98b5b5-34f2-4807-aec9-2785ee83b0ae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.161402 May 17 18:18:26.741230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 85/151] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:26 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:26.741230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b9f9ab10-6e9f-4de5-a9a6-841a803fc182 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:26.741230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b9f9ab10-6e9f-4de5-a9a6-841a803fc182 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:26.741784 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b9f9ab10-6e9f-4de5-a9a6-841a803fc182 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.742233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b9f9ab10-6e9f-4de5-a9a6-841a803fc182 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.742998 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b9f9ab10-6e9f-4de5-a9a6-841a803fc182 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:26.744023 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b9f9ab10-6e9f-4de5-a9a6-841a803fc182 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:26.878986 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b9f9ab10-6e9f-4de5-a9a6-841a803fc182 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:26.887786 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b9f9ab10-6e9f-4de5-a9a6-841a803fc182 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.155676 May 17 18:18:26.888364 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 86/152] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:26 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:27.272270 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e94f2dfb-3754-4085-8582-e1cfbfeff454 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:27.273100 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e94f2dfb-3754-4085-8582-e1cfbfeff454 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:27.281204 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e94f2dfb-3754-4085-8582-e1cfbfeff454 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.281627 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e94f2dfb-3754-4085-8582-e1cfbfeff454 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.282913 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e94f2dfb-3754-4085-8582-e1cfbfeff454 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.283621 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e94f2dfb-3754-4085-8582-e1cfbfeff454 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.410824 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e94f2dfb-3754-4085-8582-e1cfbfeff454 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:27.418920 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e94f2dfb-3754-4085-8582-e1cfbfeff454 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.150669 May 17 18:18:27.419487 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 87/153] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:27 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:27.425752 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-843768a2-ca14-447e-8508-20b1b04ec80b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:27.426356 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-843768a2-ca14-447e-8508-20b1b04ec80b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:27.432131 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-843768a2-ca14-447e-8508-20b1b04ec80b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.432515 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-843768a2-ca14-447e-8508-20b1b04ec80b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.433270 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-843768a2-ca14-447e-8508-20b1b04ec80b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.433742 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-843768a2-ca14-447e-8508-20b1b04ec80b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.561863 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-843768a2-ca14-447e-8508-20b1b04ec80b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:27.569276 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-843768a2-ca14-447e-8508-20b1b04ec80b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.147032 May 17 18:18:27.569881 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 88/154] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:27 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:27.749445 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8700f5a4-146c-4b8d-9e51-96327a48f567 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:27.750116 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-8700f5a4-146c-4b8d-9e51-96327a48f567 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:27.756589 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8700f5a4-146c-4b8d-9e51-96327a48f567 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.757048 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8700f5a4-146c-4b8d-9e51-96327a48f567 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.757959 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8700f5a4-146c-4b8d-9e51-96327a48f567 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.758304 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8700f5a4-146c-4b8d-9e51-96327a48f567 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.887971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8700f5a4-146c-4b8d-9e51-96327a48f567 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:27.896169 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8700f5a4-146c-4b8d-9e51-96327a48f567 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:27.897695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8700f5a4-146c-4b8d-9e51-96327a48f567 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:27.898803 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8700f5a4-146c-4b8d-9e51-96327a48f567 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.154623 May 17 18:18:27.900220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 89/155] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:27 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:27.904287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0224654d-faa3-46e5-b8ef-e8b0e10e290a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:27.904888 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0224654d-faa3-46e5-b8ef-e8b0e10e290a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:27.911159 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0224654d-faa3-46e5-b8ef-e8b0e10e290a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.911633 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0224654d-faa3-46e5-b8ef-e8b0e10e290a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:27.912421 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0224654d-faa3-46e5-b8ef-e8b0e10e290a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:27.912855 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0224654d-faa3-46e5-b8ef-e8b0e10e290a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.039855 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0224654d-faa3-46e5-b8ef-e8b0e10e290a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:28.047430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0224654d-faa3-46e5-b8ef-e8b0e10e290a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.146533 May 17 18:18:28.048002 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 90/156] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:27 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:28.435778 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-98e2c961-eea9-4a76-bb47-e863a5582f38 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:28.436518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-98e2c961-eea9-4a76-bb47-e863a5582f38 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:28.442497 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-98e2c961-eea9-4a76-bb47-e863a5582f38 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.442944 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-98e2c961-eea9-4a76-bb47-e863a5582f38 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.443704 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-98e2c961-eea9-4a76-bb47-e863a5582f38 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.444173 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-98e2c961-eea9-4a76-bb47-e863a5582f38 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.567884 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-98e2c961-eea9-4a76-bb47-e863a5582f38 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:28.575324 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-98e2c961-eea9-4a76-bb47-e863a5582f38 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.143709 May 17 18:18:28.575889 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 91/157] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:28 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:28.586366 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aa852e3a-6c5d-4993-bdda-add77d3743c9 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:28.587485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-aa852e3a-6c5d-4993-bdda-add77d3743c9 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:28.593284 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa852e3a-6c5d-4993-bdda-add77d3743c9 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.593773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa852e3a-6c5d-4993-bdda-add77d3743c9 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.594525 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa852e3a-6c5d-4993-bdda-add77d3743c9 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.594957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa852e3a-6c5d-4993-bdda-add77d3743c9 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.717595 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-aa852e3a-6c5d-4993-bdda-add77d3743c9 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:28.725332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-aa852e3a-6c5d-4993-bdda-add77d3743c9 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.142370 May 17 18:18:28.725949 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 92/158] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:28 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:28.917920 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e47f8aa8-b63e-427e-b0e5-5d1083527a63 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:28.918522 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e47f8aa8-b63e-427e-b0e5-5d1083527a63 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:28.924360 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e47f8aa8-b63e-427e-b0e5-5d1083527a63 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.924809 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e47f8aa8-b63e-427e-b0e5-5d1083527a63 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:28.925583 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e47f8aa8-b63e-427e-b0e5-5d1083527a63 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:28.926015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e47f8aa8-b63e-427e-b0e5-5d1083527a63 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.050394 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e47f8aa8-b63e-427e-b0e5-5d1083527a63 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:29.058463 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e47f8aa8-b63e-427e-b0e5-5d1083527a63 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:29.059958 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e47f8aa8-b63e-427e-b0e5-5d1083527a63 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:29.061049 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e47f8aa8-b63e-427e-b0e5-5d1083527a63 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.147137 May 17 18:18:29.061638 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 93/159] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:28 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:29.069927 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-51d799be-6b30-4443-91f8-e7bd46570705 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:29.069927 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-51d799be-6b30-4443-91f8-e7bd46570705 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:29.072867 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-51d799be-6b30-4443-91f8-e7bd46570705 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.073596 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-51d799be-6b30-4443-91f8-e7bd46570705 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.074357 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-51d799be-6b30-4443-91f8-e7bd46570705 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.074789 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-51d799be-6b30-4443-91f8-e7bd46570705 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.199118 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-51d799be-6b30-4443-91f8-e7bd46570705 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:29.207061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-51d799be-6b30-4443-91f8-e7bd46570705 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.144340 May 17 18:18:29.207700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 94/160] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:29 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:29.592129 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-411b00b2-97bb-4bae-954a-eff0c2e69662 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:29.592742 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-411b00b2-97bb-4bae-954a-eff0c2e69662 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:29.598665 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-411b00b2-97bb-4bae-954a-eff0c2e69662 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.599114 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-411b00b2-97bb-4bae-954a-eff0c2e69662 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.599871 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-411b00b2-97bb-4bae-954a-eff0c2e69662 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.600307 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-411b00b2-97bb-4bae-954a-eff0c2e69662 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.726274 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-411b00b2-97bb-4bae-954a-eff0c2e69662 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:29.734296 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-411b00b2-97bb-4bae-954a-eff0c2e69662 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.146053 May 17 18:18:29.734865 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 95/161] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:29 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:29.741418 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3ce8d5e2-d573-4ecd-8794-68972bf6f321 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:29.742050 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3ce8d5e2-d573-4ecd-8794-68972bf6f321 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:29.748085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ce8d5e2-d573-4ecd-8794-68972bf6f321 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.748530 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ce8d5e2-d573-4ecd-8794-68972bf6f321 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.749285 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ce8d5e2-d573-4ecd-8794-68972bf6f321 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:29.749743 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ce8d5e2-d573-4ecd-8794-68972bf6f321 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:29.875343 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3ce8d5e2-d573-4ecd-8794-68972bf6f321 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:29.882502 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3ce8d5e2-d573-4ecd-8794-68972bf6f321 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.144644 May 17 18:18:29.883088 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 96/162] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:29 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:30.078598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8937244e-2939-443e-8a1e-23e43c60f25d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:30.079240 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-8937244e-2939-443e-8a1e-23e43c60f25d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:30.085182 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8937244e-2939-443e-8a1e-23e43c60f25d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:30.085680 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8937244e-2939-443e-8a1e-23e43c60f25d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:30.086440 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8937244e-2939-443e-8a1e-23e43c60f25d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:30.087431 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8937244e-2939-443e-8a1e-23e43c60f25d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:30.210985 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8937244e-2939-443e-8a1e-23e43c60f25d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:30.219492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8937244e-2939-443e-8a1e-23e43c60f25d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:30.221002 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8937244e-2939-443e-8a1e-23e43c60f25d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:30.222142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8937244e-2939-443e-8a1e-23e43c60f25d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.147413 May 17 18:18:30.222695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 97/163] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:30 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:30.227021 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d767d94a-b81e-4770-894c-3c2dce0a6daf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:30.227621 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d767d94a-b81e-4770-894c-3c2dce0a6daf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:30.233086 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d767d94a-b81e-4770-894c-3c2dce0a6daf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:30.233569 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d767d94a-b81e-4770-894c-3c2dce0a6daf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:30.234333 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d767d94a-b81e-4770-894c-3c2dce0a6daf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:30.234776 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d767d94a-b81e-4770-894c-3c2dce0a6daf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:30.360110 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d767d94a-b81e-4770-894c-3c2dce0a6daf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:30.367300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d767d94a-b81e-4770-894c-3c2dce0a6daf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.143682 May 17 18:18:30.367862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 98/164] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:30 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:30.751894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b444db17-cef3-43d2-873a-1446f4f05d36 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:30.752494 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b444db17-cef3-43d2-873a-1446f4f05d36 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:30.758423 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b444db17-cef3-43d2-873a-1446f4f05d36 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:30.758892 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b444db17-cef3-43d2-873a-1446f4f05d36 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:30.759645 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b444db17-cef3-43d2-873a-1446f4f05d36 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:30.760126 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b444db17-cef3-43d2-873a-1446f4f05d36 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:30.883136 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b444db17-cef3-43d2-873a-1446f4f05d36 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:30.890809 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b444db17-cef3-43d2-873a-1446f4f05d36 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.143061 May 17 18:18:30.891347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 99/165] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:30 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:30.898383 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2a768fe1-8bf3-4778-a4c1-cc87dac3b6ea tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:30.898994 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2a768fe1-8bf3-4778-a4c1-cc87dac3b6ea tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:30.905271 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a768fe1-8bf3-4778-a4c1-cc87dac3b6ea tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:30.905757 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a768fe1-8bf3-4778-a4c1-cc87dac3b6ea tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:30.906523 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a768fe1-8bf3-4778-a4c1-cc87dac3b6ea tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:30.906962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a768fe1-8bf3-4778-a4c1-cc87dac3b6ea tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:31.033209 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2a768fe1-8bf3-4778-a4c1-cc87dac3b6ea tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:31.040431 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2a768fe1-8bf3-4778-a4c1-cc87dac3b6ea tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.145662 May 17 18:18:31.040992 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 100/166] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:30 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:31.239907 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-15e78450-dc4b-4961-bd6f-159910abb1c6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:31.240519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-15e78450-dc4b-4961-bd6f-159910abb1c6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:31.246921 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-15e78450-dc4b-4961-bd6f-159910abb1c6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:31.247405 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-15e78450-dc4b-4961-bd6f-159910abb1c6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:31.248173 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-15e78450-dc4b-4961-bd6f-159910abb1c6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:31.248610 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-15e78450-dc4b-4961-bd6f-159910abb1c6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:31.373135 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-15e78450-dc4b-4961-bd6f-159910abb1c6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:31.380840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-15e78450-dc4b-4961-bd6f-159910abb1c6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:31.382360 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-15e78450-dc4b-4961-bd6f-159910abb1c6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:31.383447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-15e78450-dc4b-4961-bd6f-159910abb1c6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.147483 May 17 18:18:31.384594 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 101/167] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:31 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:31.388873 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-356cbb85-960d-49ae-bd28-0375d1ce08ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:31.389485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-356cbb85-960d-49ae-bd28-0375d1ce08ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:31.395096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-356cbb85-960d-49ae-bd28-0375d1ce08ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:31.395545 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-356cbb85-960d-49ae-bd28-0375d1ce08ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:31.396299 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-356cbb85-960d-49ae-bd28-0375d1ce08ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:31.396733 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-356cbb85-960d-49ae-bd28-0375d1ce08ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:31.520665 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-356cbb85-960d-49ae-bd28-0375d1ce08ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:31.528168 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-356cbb85-960d-49ae-bd28-0375d1ce08ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.142651 May 17 18:18:31.528727 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 102/168] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:31 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:31.908273 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-78efb873-3698-4923-96c7-100dd1225afe tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:31.908878 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-78efb873-3698-4923-96c7-100dd1225afe tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:31.914741 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78efb873-3698-4923-96c7-100dd1225afe tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:31.915690 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78efb873-3698-4923-96c7-100dd1225afe tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:31.916437 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78efb873-3698-4923-96c7-100dd1225afe tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:31.916865 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78efb873-3698-4923-96c7-100dd1225afe tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:32.046898 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-78efb873-3698-4923-96c7-100dd1225afe tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:32.054227 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-78efb873-3698-4923-96c7-100dd1225afe tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.149808 May 17 18:18:32.054788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 103/169] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:31 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:32.059295 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-81b6634e-7164-40ec-8cab-a1fc2090736f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:32.059949 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-81b6634e-7164-40ec-8cab-a1fc2090736f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:32.065596 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-81b6634e-7164-40ec-8cab-a1fc2090736f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:32.066079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-81b6634e-7164-40ec-8cab-a1fc2090736f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:32.066892 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-81b6634e-7164-40ec-8cab-a1fc2090736f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:32.067376 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-81b6634e-7164-40ec-8cab-a1fc2090736f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:32.200233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-81b6634e-7164-40ec-8cab-a1fc2090736f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:32.208429 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-81b6634e-7164-40ec-8cab-a1fc2090736f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.152622 May 17 18:18:32.208996 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 104/170] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:32 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:32.401678 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c9fb2299-a1b1-48a6-b577-7203c85885bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:32.402287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c9fb2299-a1b1-48a6-b577-7203c85885bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:32.408815 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c9fb2299-a1b1-48a6-b577-7203c85885bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:32.409268 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c9fb2299-a1b1-48a6-b577-7203c85885bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:32.410052 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c9fb2299-a1b1-48a6-b577-7203c85885bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:32.410492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c9fb2299-a1b1-48a6-b577-7203c85885bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:32.537288 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c9fb2299-a1b1-48a6-b577-7203c85885bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:32.545976 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c9fb2299-a1b1-48a6-b577-7203c85885bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:32.547492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c9fb2299-a1b1-48a6-b577-7203c85885bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:32.548589 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c9fb2299-a1b1-48a6-b577-7203c85885bc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.150748 May 17 18:18:32.549132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 105/171] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:32 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:32.553410 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-20b5f5f1-e3f2-49ba-b808-3cfbf56873a4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:32.554049 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-20b5f5f1-e3f2-49ba-b808-3cfbf56873a4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:32.560593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20b5f5f1-e3f2-49ba-b808-3cfbf56873a4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:32.561224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20b5f5f1-e3f2-49ba-b808-3cfbf56873a4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:32.562212 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20b5f5f1-e3f2-49ba-b808-3cfbf56873a4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:32.562714 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20b5f5f1-e3f2-49ba-b808-3cfbf56873a4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:32.687535 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-20b5f5f1-e3f2-49ba-b808-3cfbf56873a4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:32.694794 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-20b5f5f1-e3f2-49ba-b808-3cfbf56873a4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.144712 May 17 18:18:32.695353 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 106/172] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:32 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:33.070203 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-51080795-602a-421d-a68c-5c6fe6cc7d27 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:33.070810 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-51080795-602a-421d-a68c-5c6fe6cc7d27 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:33.076973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-51080795-602a-421d-a68c-5c6fe6cc7d27 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:33.077424 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-51080795-602a-421d-a68c-5c6fe6cc7d27 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:33.078215 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-51080795-602a-421d-a68c-5c6fe6cc7d27 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:33.078651 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-51080795-602a-421d-a68c-5c6fe6cc7d27 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:33.263300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-51080795-602a-421d-a68c-5c6fe6cc7d27 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:33.268895 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-51080795-602a-421d-a68c-5c6fe6cc7d27 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.202128 May 17 18:18:33.273538 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 107/173] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:33 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:33.274911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e3e7d26e-5ff7-4447-8818-b7f82b60c06b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:33.275307 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e3e7d26e-5ff7-4447-8818-b7f82b60c06b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:33.281738 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e3e7d26e-5ff7-4447-8818-b7f82b60c06b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:33.282303 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e3e7d26e-5ff7-4447-8818-b7f82b60c06b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:33.283455 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e3e7d26e-5ff7-4447-8818-b7f82b60c06b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:33.284062 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e3e7d26e-5ff7-4447-8818-b7f82b60c06b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:33.449407 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e3e7d26e-5ff7-4447-8818-b7f82b60c06b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:33.457163 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e3e7d26e-5ff7-4447-8818-b7f82b60c06b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.186521 May 17 18:18:33.461838 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 108/174] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:33 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:33.559457 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-4352bc99-2642-4de7-a7fd-0fb0d458c9d3 req-a6b685f8-26b1-4d84-8070-d32f378b7257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e0dba9-a1b6-44ad-af16-8419624a2ba6", "name": "network-vif-plugged", "status": "completed", "tag": "43a789b0-1ac7-4729-8cc9-8ad941391439"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:33.570007 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-4352bc99-2642-4de7-a7fd-0fb0d458c9d3 req-a6b685f8-26b1-4d84-8070-d32f378b7257 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:33.570557 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-4352bc99-2642-4de7-a7fd-0fb0d458c9d3 req-a6b685f8-26b1-4d84-8070-d32f378b7257 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:33.586147 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-4352bc99-2642-4de7-a7fd-0fb0d458c9d3 req-a6b685f8-26b1-4d84-8070-d32f378b7257 service nova] Creating event network-vif-plugged:43a789b0-1ac7-4729-8cc9-8ad941391439 for instance 56e0dba9-a1b6-44ad-af16-8419624a2ba6 on hv-cinder-83736 May 17 18:18:33.591944 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-4352bc99-2642-4de7-a7fd-0fb0d458c9d3 req-a6b685f8-26b1-4d84-8070-d32f378b7257 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036951 May 17 18:18:33.592687 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 109/175] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:18:33.598096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0dcc8bac-3e8a-46cc-9222-68f48af6597d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:33.598846 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0dcc8bac-3e8a-46cc-9222-68f48af6597d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:33.608415 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0dcc8bac-3e8a-46cc-9222-68f48af6597d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:33.608415 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0dcc8bac-3e8a-46cc-9222-68f48af6597d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:33.608415 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0dcc8bac-3e8a-46cc-9222-68f48af6597d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:33.608415 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0dcc8bac-3e8a-46cc-9222-68f48af6597d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:33.787174 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0dcc8bac-3e8a-46cc-9222-68f48af6597d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:33.796027 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0dcc8bac-3e8a-46cc-9222-68f48af6597d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:33.797637 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0dcc8bac-3e8a-46cc-9222-68f48af6597d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:33.798655 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0dcc8bac-3e8a-46cc-9222-68f48af6597d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.204918 May 17 18:18:33.799384 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 110/176] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:33 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:33.806318 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-019d5736-c534-4070-9540-fb21e322f731 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:33.807140 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-019d5736-c534-4070-9540-fb21e322f731 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:33.813569 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-019d5736-c534-4070-9540-fb21e322f731 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:33.814256 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-019d5736-c534-4070-9540-fb21e322f731 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:33.815298 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-019d5736-c534-4070-9540-fb21e322f731 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:33.816275 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-019d5736-c534-4070-9540-fb21e322f731 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:33.954683 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-019d5736-c534-4070-9540-fb21e322f731 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:33.963343 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-019d5736-c534-4070-9540-fb21e322f731 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.163002 May 17 18:18:33.964098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 111/177] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:33 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:34.286061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-891d767c-0349-41b7-b9ff-12a36cbbbc16 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:34.286749 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-891d767c-0349-41b7-b9ff-12a36cbbbc16 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:34.294867 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-891d767c-0349-41b7-b9ff-12a36cbbbc16 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:34.295511 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-891d767c-0349-41b7-b9ff-12a36cbbbc16 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:34.296332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-891d767c-0349-41b7-b9ff-12a36cbbbc16 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:34.296767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-891d767c-0349-41b7-b9ff-12a36cbbbc16 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:34.428024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-891d767c-0349-41b7-b9ff-12a36cbbbc16 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:34.435367 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-891d767c-0349-41b7-b9ff-12a36cbbbc16 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.153529 May 17 18:18:34.435919 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 112/178] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:34 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:34.474750 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ed7ab52a-dd6e-4144-871c-f5920ed6ecbb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:34.475358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ed7ab52a-dd6e-4144-871c-f5920ed6ecbb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:34.481932 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed7ab52a-dd6e-4144-871c-f5920ed6ecbb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:34.482405 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed7ab52a-dd6e-4144-871c-f5920ed6ecbb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:34.483149 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed7ab52a-dd6e-4144-871c-f5920ed6ecbb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:34.483580 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed7ab52a-dd6e-4144-871c-f5920ed6ecbb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:34.622981 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ed7ab52a-dd6e-4144-871c-f5920ed6ecbb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:34.632245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ed7ab52a-dd6e-4144-871c-f5920ed6ecbb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.161106 May 17 18:18:34.633062 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 113/179] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:34 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:34.818042 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ba8a5a33-d94b-490e-aba4-bbbde055f102 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:34.818652 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ba8a5a33-d94b-490e-aba4-bbbde055f102 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:34.824688 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ba8a5a33-d94b-490e-aba4-bbbde055f102 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:34.825129 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ba8a5a33-d94b-490e-aba4-bbbde055f102 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:34.825926 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ba8a5a33-d94b-490e-aba4-bbbde055f102 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:34.826368 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ba8a5a33-d94b-490e-aba4-bbbde055f102 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:34.970140 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ba8a5a33-d94b-490e-aba4-bbbde055f102 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:34.978608 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ba8a5a33-d94b-490e-aba4-bbbde055f102 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:34.980121 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ba8a5a33-d94b-490e-aba4-bbbde055f102 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:34.981227 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ba8a5a33-d94b-490e-aba4-bbbde055f102 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.167069 May 17 18:18:34.981990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 114/180] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:34 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:34.994446 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-32e54035-0f01-41f9-9574-8d0a265b8689 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:34.995056 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-32e54035-0f01-41f9-9574-8d0a265b8689 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:35.000825 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-32e54035-0f01-41f9-9574-8d0a265b8689 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:35.001278 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-32e54035-0f01-41f9-9574-8d0a265b8689 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:35.002075 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-32e54035-0f01-41f9-9574-8d0a265b8689 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:35.002510 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-32e54035-0f01-41f9-9574-8d0a265b8689 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:35.137333 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-32e54035-0f01-41f9-9574-8d0a265b8689 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:35.145392 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-32e54035-0f01-41f9-9574-8d0a265b8689 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.154907 May 17 18:18:35.145982 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 115/181] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:34 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:35.453758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-893480c4-942c-4128-b902-d9d2f9d071b2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:35.454588 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-893480c4-942c-4128-b902-d9d2f9d071b2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:35.461296 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-893480c4-942c-4128-b902-d9d2f9d071b2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:35.462431 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-893480c4-942c-4128-b902-d9d2f9d071b2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:35.464113 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-893480c4-942c-4128-b902-d9d2f9d071b2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:35.465875 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-893480c4-942c-4128-b902-d9d2f9d071b2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:35.638723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-893480c4-942c-4128-b902-d9d2f9d071b2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:35.647175 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-893480c4-942c-4128-b902-d9d2f9d071b2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.197290 May 17 18:18:35.647749 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 116/182] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:35 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:35.655012 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-a1d639e0-aeb3-4ffe-8082-b26afb744e5f req-ad30507e-e3a4-4805-9dca-1cc0bcfe891a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b730dca-866b-4096-9175-6d27c3d35e55", "name": "network-vif-plugged", "status": "completed", "tag": "d33b9990-24b2-40c1-bba4-2f0d0da36778"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:35.676700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-a1d639e0-aeb3-4ffe-8082-b26afb744e5f req-ad30507e-e3a4-4805-9dca-1cc0bcfe891a service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:35.677195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-a1d639e0-aeb3-4ffe-8082-b26afb744e5f req-ad30507e-e3a4-4805-9dca-1cc0bcfe891a service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:35.689382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-a1d639e0-aeb3-4ffe-8082-b26afb744e5f req-ad30507e-e3a4-4805-9dca-1cc0bcfe891a service nova] Creating event network-vif-plugged:d33b9990-24b2-40c1-bba4-2f0d0da36778 for instance 8b730dca-866b-4096-9175-6d27c3d35e55 on hv-cinder-83736 May 17 18:18:35.694438 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-a1d639e0-aeb3-4ffe-8082-b26afb744e5f req-ad30507e-e3a4-4805-9dca-1cc0bcfe891a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045460 May 17 18:18:35.695112 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 117/183] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:35.700958 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6b072eda-7df8-406c-85b3-945cae70ec23 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:35.701866 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6b072eda-7df8-406c-85b3-945cae70ec23 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:35.708711 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6b072eda-7df8-406c-85b3-945cae70ec23 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:35.709167 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6b072eda-7df8-406c-85b3-945cae70ec23 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:35.709984 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6b072eda-7df8-406c-85b3-945cae70ec23 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:35.710428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6b072eda-7df8-406c-85b3-945cae70ec23 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:35.862597 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6b072eda-7df8-406c-85b3-945cae70ec23 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:35.876205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6b072eda-7df8-406c-85b3-945cae70ec23 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.179782 May 17 18:18:35.877055 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 118/184] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:35 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:36.013945 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ed6f1bab-bf79-4527-a685-94ac3a09d75f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:36.014995 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ed6f1bab-bf79-4527-a685-94ac3a09d75f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:36.022891 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed6f1bab-bf79-4527-a685-94ac3a09d75f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:36.023344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed6f1bab-bf79-4527-a685-94ac3a09d75f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:36.024673 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed6f1bab-bf79-4527-a685-94ac3a09d75f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:36.025154 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed6f1bab-bf79-4527-a685-94ac3a09d75f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:36.237319 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ed6f1bab-bf79-4527-a685-94ac3a09d75f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:36.245764 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ed6f1bab-bf79-4527-a685-94ac3a09d75f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:36.247284 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ed6f1bab-bf79-4527-a685-94ac3a09d75f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:36.248389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ed6f1bab-bf79-4527-a685-94ac3a09d75f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.240553 May 17 18:18:36.254280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 119/185] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:36 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:36.259520 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-08d57f02-316a-419f-b150-d460a7688d24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:36.260294 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-08d57f02-316a-419f-b150-d460a7688d24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:36.266446 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-08d57f02-316a-419f-b150-d460a7688d24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:36.266903 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-08d57f02-316a-419f-b150-d460a7688d24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:36.267676 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-08d57f02-316a-419f-b150-d460a7688d24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:36.268118 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-08d57f02-316a-419f-b150-d460a7688d24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:36.423557 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-08d57f02-316a-419f-b150-d460a7688d24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:36.431189 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-08d57f02-316a-419f-b150-d460a7688d24 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.181129 May 17 18:18:36.431770 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 120/186] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:36 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:36.664280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5b3b2afd-1c70-452d-8d59-57a942dc321c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:36.664851 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5b3b2afd-1c70-452d-8d59-57a942dc321c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:36.675040 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5b3b2afd-1c70-452d-8d59-57a942dc321c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:36.675767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5b3b2afd-1c70-452d-8d59-57a942dc321c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:36.676809 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5b3b2afd-1c70-452d-8d59-57a942dc321c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:36.677804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5b3b2afd-1c70-452d-8d59-57a942dc321c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:36.831071 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5b3b2afd-1c70-452d-8d59-57a942dc321c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:36.838508 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5b3b2afd-1c70-452d-8d59-57a942dc321c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.178206 May 17 18:18:36.839297 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 121/187] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:36 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:36.893041 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d7c88ac3-17e1-4795-9ec5-b7d72833df19 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:36.893834 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d7c88ac3-17e1-4795-9ec5-b7d72833df19 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:36.900475 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d7c88ac3-17e1-4795-9ec5-b7d72833df19 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:36.901005 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d7c88ac3-17e1-4795-9ec5-b7d72833df19 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:36.901895 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d7c88ac3-17e1-4795-9ec5-b7d72833df19 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:36.902405 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d7c88ac3-17e1-4795-9ec5-b7d72833df19 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:37.056395 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d7c88ac3-17e1-4795-9ec5-b7d72833df19 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:37.063928 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d7c88ac3-17e1-4795-9ec5-b7d72833df19 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.174731 May 17 18:18:37.064504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 122/188] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:36 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:37.272417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-40120b12-8a38-4dc0-a3ae-af7ce753f4b6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:37.273047 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-40120b12-8a38-4dc0-a3ae-af7ce753f4b6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:37.287087 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40120b12-8a38-4dc0-a3ae-af7ce753f4b6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:37.288515 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40120b12-8a38-4dc0-a3ae-af7ce753f4b6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:37.292725 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40120b12-8a38-4dc0-a3ae-af7ce753f4b6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:37.293415 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40120b12-8a38-4dc0-a3ae-af7ce753f4b6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:37.498065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-40120b12-8a38-4dc0-a3ae-af7ce753f4b6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:37.509114 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-40120b12-8a38-4dc0-a3ae-af7ce753f4b6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:37.510960 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-40120b12-8a38-4dc0-a3ae-af7ce753f4b6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:37.512488 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-40120b12-8a38-4dc0-a3ae-af7ce753f4b6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.249800 May 17 18:18:37.513317 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 123/189] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:37 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:37.518270 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1e3d18f5-b72d-4fcf-9015-4b5f633f47af tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:37.519085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1e3d18f5-b72d-4fcf-9015-4b5f633f47af tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:37.528972 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1e3d18f5-b72d-4fcf-9015-4b5f633f47af tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:37.529428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1e3d18f5-b72d-4fcf-9015-4b5f633f47af tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:37.530300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1e3d18f5-b72d-4fcf-9015-4b5f633f47af tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:37.530782 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1e3d18f5-b72d-4fcf-9015-4b5f633f47af tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:37.677382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1e3d18f5-b72d-4fcf-9015-4b5f633f47af tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:37.686476 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1e3d18f5-b72d-4fcf-9015-4b5f633f47af tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.171639 May 17 18:18:37.687116 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 124/190] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:37 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:37.856499 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-75b8ac00-9546-47ea-9d1b-de5789b2b3e6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:37.857089 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-75b8ac00-9546-47ea-9d1b-de5789b2b3e6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:37.863000 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-75b8ac00-9546-47ea-9d1b-de5789b2b3e6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:37.863457 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-75b8ac00-9546-47ea-9d1b-de5789b2b3e6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:37.864237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-75b8ac00-9546-47ea-9d1b-de5789b2b3e6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:37.864677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-75b8ac00-9546-47ea-9d1b-de5789b2b3e6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:38.014517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-75b8ac00-9546-47ea-9d1b-de5789b2b3e6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:38.021940 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-75b8ac00-9546-47ea-9d1b-de5789b2b3e6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.169873 May 17 18:18:38.022733 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 125/191] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:37 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:38.080712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-78accf08-c874-452a-9280-37e0949d23cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:38.081721 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-78accf08-c874-452a-9280-37e0949d23cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:38.089174 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78accf08-c874-452a-9280-37e0949d23cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:38.089948 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78accf08-c874-452a-9280-37e0949d23cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:38.091041 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78accf08-c874-452a-9280-37e0949d23cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:38.091866 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78accf08-c874-452a-9280-37e0949d23cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:38.377106 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-78accf08-c874-452a-9280-37e0949d23cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:38.385602 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-78accf08-c874-452a-9280-37e0949d23cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.309245 May 17 18:18:38.386176 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 126/192] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:38 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:38.440805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ca38a011-c629-4868-ad95-ae9e7c11bdd8 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "POST /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.653737 May 17 18:18:38.441494 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 67/193] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:18:21 2022] POST /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3/os-volume_attachments => generated 194 bytes in 16656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:38.531181 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-71ed5fa2-bd70-4f4b-b480-319c2ced5134 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:38.531800 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-71ed5fa2-bd70-4f4b-b480-319c2ced5134 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:38.539952 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-71ed5fa2-bd70-4f4b-b480-319c2ced5134 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:38.540874 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-71ed5fa2-bd70-4f4b-b480-319c2ced5134 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:38.541688 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-71ed5fa2-bd70-4f4b-b480-319c2ced5134 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:38.542136 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-71ed5fa2-bd70-4f4b-b480-319c2ced5134 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:38.681288 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-71ed5fa2-bd70-4f4b-b480-319c2ced5134 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:38.690875 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-71ed5fa2-bd70-4f4b-b480-319c2ced5134 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:38.692923 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-71ed5fa2-bd70-4f4b-b480-319c2ced5134 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:38.694113 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-71ed5fa2-bd70-4f4b-b480-319c2ced5134 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.166957 May 17 18:18:38.694705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 127/194] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:38 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:38.711275 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3442dcef-bf1b-4494-b520-bf17a5b9448a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:38.712549 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-3442dcef-bf1b-4494-b520-bf17a5b9448a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:38.719586 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3442dcef-bf1b-4494-b520-bf17a5b9448a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:38.720050 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3442dcef-bf1b-4494-b520-bf17a5b9448a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:38.720832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3442dcef-bf1b-4494-b520-bf17a5b9448a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:38.721273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3442dcef-bf1b-4494-b520-bf17a5b9448a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:39.010312 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-3442dcef-bf1b-4494-b520-bf17a5b9448a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:39.018164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-3442dcef-bf1b-4494-b520-bf17a5b9448a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.310886 May 17 18:18:39.018707 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 68/195] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:38 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:39.042053 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-eda5f691-1883-4070-b34c-fbb90d72269e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:39.042923 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-eda5f691-1883-4070-b34c-fbb90d72269e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:39.054551 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-eda5f691-1883-4070-b34c-fbb90d72269e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:39.055344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-eda5f691-1883-4070-b34c-fbb90d72269e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:39.056821 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-eda5f691-1883-4070-b34c-fbb90d72269e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:39.057908 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-eda5f691-1883-4070-b34c-fbb90d72269e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:39.273253 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-eda5f691-1883-4070-b34c-fbb90d72269e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:39.286705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-eda5f691-1883-4070-b34c-fbb90d72269e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.250837 May 17 18:18:39.287572 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 128/196] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:39 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:39.403762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c3be6e10-e417-4a1d-8635-1ff50ef07d49 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:39.404382 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c3be6e10-e417-4a1d-8635-1ff50ef07d49 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:39.412853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c3be6e10-e417-4a1d-8635-1ff50ef07d49 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:39.413238 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c3be6e10-e417-4a1d-8635-1ff50ef07d49 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:39.414046 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c3be6e10-e417-4a1d-8635-1ff50ef07d49 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:39.427871 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c3be6e10-e417-4a1d-8635-1ff50ef07d49 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:39.636825 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-c825a9c9-7d7c-4e5c-abfe-c41ac66b5542 req-b7917f7c-ad25-4413-8878-04654fe63007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e", "name": "network-vif-plugged", "status": "completed", "tag": "06e106bb-68fb-497b-a3fb-dae45c0c334c"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:39.651575 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-c825a9c9-7d7c-4e5c-abfe-c41ac66b5542 req-b7917f7c-ad25-4413-8878-04654fe63007 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:39.653587 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-c825a9c9-7d7c-4e5c-abfe-c41ac66b5542 req-b7917f7c-ad25-4413-8878-04654fe63007 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:39.687860 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-c825a9c9-7d7c-4e5c-abfe-c41ac66b5542 req-b7917f7c-ad25-4413-8878-04654fe63007 service nova] Creating event network-vif-plugged:06e106bb-68fb-497b-a3fb-dae45c0c334c for instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e on hv-cinder-83736 May 17 18:18:39.705178 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-c825a9c9-7d7c-4e5c-abfe-c41ac66b5542 req-b7917f7c-ad25-4413-8878-04654fe63007 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069973 May 17 18:18:39.705850 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 129/197] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:39.726082 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-02d873e6-76c1-48f1-9661-12781845f0eb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:39.730059 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-02d873e6-76c1-48f1-9661-12781845f0eb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:39.747430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-02d873e6-76c1-48f1-9661-12781845f0eb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:39.748920 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-02d873e6-76c1-48f1-9661-12781845f0eb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:39.751668 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-02d873e6-76c1-48f1-9661-12781845f0eb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:39.752518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-02d873e6-76c1-48f1-9661-12781845f0eb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:39.886115 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c3be6e10-e417-4a1d-8635-1ff50ef07d49 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:39.900020 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c3be6e10-e417-4a1d-8635-1ff50ef07d49 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.500302 May 17 18:18:39.901836 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 69/198] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:39 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:40.013600 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-02d873e6-76c1-48f1-9661-12781845f0eb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:40.022137 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-02d873e6-76c1-48f1-9661-12781845f0eb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:40.023665 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-02d873e6-76c1-48f1-9661-12781845f0eb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:40.025332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-02d873e6-76c1-48f1-9661-12781845f0eb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.315924 May 17 18:18:40.026428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 130/199] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:39 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:40.041227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-65337db1-a9d2-4fd2-999a-8ba23ede06a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.041902 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-65337db1-a9d2-4fd2-999a-8ba23ede06a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:40.048115 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-65337db1-a9d2-4fd2-999a-8ba23ede06a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:40.048773 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-65337db1-a9d2-4fd2-999a-8ba23ede06a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:40.049608 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-65337db1-a9d2-4fd2-999a-8ba23ede06a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:40.050049 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-65337db1-a9d2-4fd2-999a-8ba23ede06a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:40.193738 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-65337db1-a9d2-4fd2-999a-8ba23ede06a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:40.203788 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-65337db1-a9d2-4fd2-999a-8ba23ede06a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.166333 May 17 18:18:40.204648 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 70/200] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:40.304197 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-26fde55f-e1ff-4564-b11d-15dac2f59110 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.304800 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-26fde55f-e1ff-4564-b11d-15dac2f59110 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:40.311250 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-26fde55f-e1ff-4564-b11d-15dac2f59110 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:40.311702 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-26fde55f-e1ff-4564-b11d-15dac2f59110 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:40.312528 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-26fde55f-e1ff-4564-b11d-15dac2f59110 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:40.312914 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-26fde55f-e1ff-4564-b11d-15dac2f59110 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:40.488672 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-26fde55f-e1ff-4564-b11d-15dac2f59110 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:40.497832 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-26fde55f-e1ff-4564-b11d-15dac2f59110 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.197378 May 17 18:18:40.498518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 131/201] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:40.917807 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5934ea72-bd0d-4ace-9891-4d6808b2f048 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:40.918482 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5934ea72-bd0d-4ace-9891-4d6808b2f048 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:40.925263 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5934ea72-bd0d-4ace-9891-4d6808b2f048 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:40.925755 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5934ea72-bd0d-4ace-9891-4d6808b2f048 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:40.926525 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5934ea72-bd0d-4ace-9891-4d6808b2f048 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:40.927138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5934ea72-bd0d-4ace-9891-4d6808b2f048 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:41.047325 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d79a1940-0d0f-4ca1-bf7e-66d901bde158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:41.047949 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d79a1940-0d0f-4ca1-bf7e-66d901bde158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:41.054650 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d79a1940-0d0f-4ca1-bf7e-66d901bde158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:41.055937 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d79a1940-0d0f-4ca1-bf7e-66d901bde158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:41.057255 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d79a1940-0d0f-4ca1-bf7e-66d901bde158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:41.057844 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d79a1940-0d0f-4ca1-bf7e-66d901bde158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:41.126493 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5934ea72-bd0d-4ace-9891-4d6808b2f048 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:41.134217 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5934ea72-bd0d-4ace-9891-4d6808b2f048 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1364 microversion: 2.1 time: 0.219722 May 17 18:18:41.141800 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 71/202] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:40 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:41.222165 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0caab086-6208-4f3c-a66a-efa417fb2495 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:41.223157 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0caab086-6208-4f3c-a66a-efa417fb2495 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:41.234205 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0caab086-6208-4f3c-a66a-efa417fb2495 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:41.235265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0caab086-6208-4f3c-a66a-efa417fb2495 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:41.237503 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0caab086-6208-4f3c-a66a-efa417fb2495 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:41.238576 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0caab086-6208-4f3c-a66a-efa417fb2495 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:41.372021 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d79a1940-0d0f-4ca1-bf7e-66d901bde158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:41.388654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d79a1940-0d0f-4ca1-bf7e-66d901bde158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:41.397356 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d79a1940-0d0f-4ca1-bf7e-66d901bde158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:41.403409 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d79a1940-0d0f-4ca1-bf7e-66d901bde158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.361376 May 17 18:18:41.404920 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 132/203] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:41 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:18:41.515109 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9249816b-a2b9-4af7-a81b-dca49e23db5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:41.515721 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9249816b-a2b9-4af7-a81b-dca49e23db5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:41.522917 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9249816b-a2b9-4af7-a81b-dca49e23db5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:41.524859 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9249816b-a2b9-4af7-a81b-dca49e23db5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:41.531963 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9249816b-a2b9-4af7-a81b-dca49e23db5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:41.532438 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9249816b-a2b9-4af7-a81b-dca49e23db5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:41.574804 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0caab086-6208-4f3c-a66a-efa417fb2495 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:41.583270 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0caab086-6208-4f3c-a66a-efa417fb2495 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1320 microversion: 2.1 time: 0.365363 May 17 18:18:41.596693 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 72/204] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:41 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1320 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:41.735951 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9249816b-a2b9-4af7-a81b-dca49e23db5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:41.745428 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-805673f0-8411-44e6-bf8f-4b174b788a68 req-3db3c754-a319-4798-85ec-cfda20c214e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f92bd0-84e7-4e4f-b596-c73c9453ce85", "name": "network-vif-plugged", "status": "completed", "tag": "200d9682-a32c-4f1b-afac-5e03e64190d5"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:41.757359 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-805673f0-8411-44e6-bf8f-4b174b788a68 req-3db3c754-a319-4798-85ec-cfda20c214e2 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:41.757836 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-805673f0-8411-44e6-bf8f-4b174b788a68 req-3db3c754-a319-4798-85ec-cfda20c214e2 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:41.758616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9249816b-a2b9-4af7-a81b-dca49e23db5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.243065 May 17 18:18:41.759451 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 133/205] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:41 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:41.771923 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-805673f0-8411-44e6-bf8f-4b174b788a68 req-3db3c754-a319-4798-85ec-cfda20c214e2 service nova] Creating event network-vif-plugged:200d9682-a32c-4f1b-afac-5e03e64190d5 for instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 on hv-cinder-83736 May 17 18:18:41.778004 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-805673f0-8411-44e6-bf8f-4b174b788a68 req-3db3c754-a319-4798-85ec-cfda20c214e2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039450 May 17 18:18:41.779212 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 73/206] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:42.151023 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e6502041-c486-4697-9e42-27ae14475337 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:42.151753 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e6502041-c486-4697-9e42-27ae14475337 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:42.157794 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e6502041-c486-4697-9e42-27ae14475337 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:42.158329 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e6502041-c486-4697-9e42-27ae14475337 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:42.159178 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e6502041-c486-4697-9e42-27ae14475337 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:42.159694 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e6502041-c486-4697-9e42-27ae14475337 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:42.310747 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e6502041-c486-4697-9e42-27ae14475337 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:42.320049 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e6502041-c486-4697-9e42-27ae14475337 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1549 microversion: 2.1 time: 0.173039 May 17 18:18:42.320832 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 134/207] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:42 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:42.338662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b0093315-788f-4325-8950-ef996df58294 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:42.339209 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b0093315-788f-4325-8950-ef996df58294 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:42.349065 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0093315-788f-4325-8950-ef996df58294 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:42.349449 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0093315-788f-4325-8950-ef996df58294 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:42.350247 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0093315-788f-4325-8950-ef996df58294 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:42.350883 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0093315-788f-4325-8950-ef996df58294 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:42.425844 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6744aa1a-d400-43ba-af25-163747802983 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:42.426633 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6744aa1a-d400-43ba-af25-163747802983 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:42.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6744aa1a-d400-43ba-af25-163747802983 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:42.439001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6744aa1a-d400-43ba-af25-163747802983 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:42.454573 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6744aa1a-d400-43ba-af25-163747802983 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:42.454573 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6744aa1a-d400-43ba-af25-163747802983 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:42.467732 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b0093315-788f-4325-8950-ef996df58294 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133689 May 17 18:18:42.468929 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 74/208] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 17 18:18:42 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/os-interface => generated 284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:18:42.604738 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9e8387b8-c707-4b2f-913b-15f93cd0fe41 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:42.606716 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-9e8387b8-c707-4b2f-913b-15f93cd0fe41 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:42.620691 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9e8387b8-c707-4b2f-913b-15f93cd0fe41 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:42.621152 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9e8387b8-c707-4b2f-913b-15f93cd0fe41 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:42.621967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9e8387b8-c707-4b2f-913b-15f93cd0fe41 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:42.622408 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9e8387b8-c707-4b2f-913b-15f93cd0fe41 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:43.018010 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6744aa1a-d400-43ba-af25-163747802983 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:43.026742 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6744aa1a-d400-43ba-af25-163747802983 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:43.028351 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6744aa1a-d400-43ba-af25-163747802983 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:43.037641 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6744aa1a-d400-43ba-af25-163747802983 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.608973 May 17 18:18:43.038299 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 135/209] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:42 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:43.043051 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-33802473-69ee-4e8c-81c4-b585acfb2690 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:43.043671 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-33802473-69ee-4e8c-81c4-b585acfb2690 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:43.059492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-33802473-69ee-4e8c-81c4-b585acfb2690 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:43.060004 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-33802473-69ee-4e8c-81c4-b585acfb2690 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:43.062083 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-33802473-69ee-4e8c-81c4-b585acfb2690 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:43.063436 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-33802473-69ee-4e8c-81c4-b585acfb2690 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:43.113667 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-9e8387b8-c707-4b2f-913b-15f93cd0fe41 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:43.130022 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9e8387b8-c707-4b2f-913b-15f93cd0fe41 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1513 microversion: 2.1 time: 0.532263 May 17 18:18:43.137506 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 75/210] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:42 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1513 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:43.147762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5a6b0e9c-6a7a-4fa9-8d28-77b7703ec7a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:43.149603 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5a6b0e9c-6a7a-4fa9-8d28-77b7703ec7a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:43.160236 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a6b0e9c-6a7a-4fa9-8d28-77b7703ec7a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:43.161907 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a6b0e9c-6a7a-4fa9-8d28-77b7703ec7a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:43.162914 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a6b0e9c-6a7a-4fa9-8d28-77b7703ec7a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:43.165292 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a6b0e9c-6a7a-4fa9-8d28-77b7703ec7a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:43.216784 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-5a6b0e9c-6a7a-4fa9-8d28-77b7703ec7a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lazy-loading 'flavor' on Instance uuid 56e0dba9-a1b6-44ad-af16-8419624a2ba6 {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:18:43.381752 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-33802473-69ee-4e8c-81c4-b585acfb2690 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:43.397901 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-33802473-69ee-4e8c-81c4-b585acfb2690 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.358494 May 17 18:18:43.406967 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 136/211] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:43 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:43.407136 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5a6b0e9c-6a7a-4fa9-8d28-77b7703ec7a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "POST /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6/action" status: 200 len: 32 microversion: 2.1 time: 0.257921 May 17 18:18:43.407550 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 76/212] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:18:43 2022] POST /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6/action => generated 32 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 17 18:18:43.411937 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-385775f3-09c2-4a99-a23e-f49da08d5e9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:43.412559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-385775f3-09c2-4a99-a23e-f49da08d5e9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:43.419080 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-385775f3-09c2-4a99-a23e-f49da08d5e9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:43.419175 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-385775f3-09c2-4a99-a23e-f49da08d5e9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:43.419940 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-385775f3-09c2-4a99-a23e-f49da08d5e9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:43.420383 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-385775f3-09c2-4a99-a23e-f49da08d5e9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:43.739594 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-385775f3-09c2-4a99-a23e-f49da08d5e9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:43.750224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-385775f3-09c2-4a99-a23e-f49da08d5e9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.341938 May 17 18:18:43.750827 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 137/213] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:43 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:44.060642 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-80a10bd2-5f21-41e2-befc-27dd5559c38b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:44.062152 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-80a10bd2-5f21-41e2-befc-27dd5559c38b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:44.074585 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-80a10bd2-5f21-41e2-befc-27dd5559c38b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:44.075339 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-80a10bd2-5f21-41e2-befc-27dd5559c38b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:44.076359 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-80a10bd2-5f21-41e2-befc-27dd5559c38b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:44.076789 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-80a10bd2-5f21-41e2-befc-27dd5559c38b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:44.347960 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-80a10bd2-5f21-41e2-befc-27dd5559c38b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:44.367297 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-80a10bd2-5f21-41e2-befc-27dd5559c38b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:44.369579 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-80a10bd2-5f21-41e2-befc-27dd5559c38b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:44.370704 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-80a10bd2-5f21-41e2-befc-27dd5559c38b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.318062 May 17 18:18:44.371267 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 77/214] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:44 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:44.417721 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-59bc2f1e-88ec-4d38-baa4-eaa7017cb0ce tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:44.417721 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-59bc2f1e-88ec-4d38-baa4-eaa7017cb0ce tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:44.431412 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-59bc2f1e-88ec-4d38-baa4-eaa7017cb0ce tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:44.431925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-59bc2f1e-88ec-4d38-baa4-eaa7017cb0ce tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:44.432701 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-59bc2f1e-88ec-4d38-baa4-eaa7017cb0ce tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:44.435350 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-59bc2f1e-88ec-4d38-baa4-eaa7017cb0ce tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:44.767404 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-efb57a5b-c4dc-4149-8903-274d1bd661fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:44.768950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-efb57a5b-c4dc-4149-8903-274d1bd661fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:44.777288 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-efb57a5b-c4dc-4149-8903-274d1bd661fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:44.778021 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-efb57a5b-c4dc-4149-8903-274d1bd661fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:44.785866 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-efb57a5b-c4dc-4149-8903-274d1bd661fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:44.787767 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-efb57a5b-c4dc-4149-8903-274d1bd661fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:45.061856 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-59bc2f1e-88ec-4d38-baa4-eaa7017cb0ce tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:45.070411 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-efb57a5b-c4dc-4149-8903-274d1bd661fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:45.071051 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-59bc2f1e-88ec-4d38-baa4-eaa7017cb0ce tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.659305 May 17 18:18:45.081500 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 138/215] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:44 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:45.088509 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-efb57a5b-c4dc-4149-8903-274d1bd661fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.325129 May 17 18:18:45.099511 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 78/216] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:44 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:45.143559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-4bb1e553-5f25-4d96-876f-c58ec4f4f4ea req-91b965fb-9ad0-40c6-8e4a-a2b33e7dc64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b730dca-866b-4096-9175-6d27c3d35e55", "tag": "d33b9990-24b2-40c1-bba4-2f0d0da36778"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:45.154428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-4bb1e553-5f25-4d96-876f-c58ec4f4f4ea req-91b965fb-9ad0-40c6-8e4a-a2b33e7dc64d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:45.158496 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-4bb1e553-5f25-4d96-876f-c58ec4f4f4ea req-91b965fb-9ad0-40c6-8e4a-a2b33e7dc64d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:45.205704 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-4bb1e553-5f25-4d96-876f-c58ec4f4f4ea req-91b965fb-9ad0-40c6-8e4a-a2b33e7dc64d service nova] Creating event network-changed:d33b9990-24b2-40c1-bba4-2f0d0da36778 for instance 8b730dca-866b-4096-9175-6d27c3d35e55 on hv-cinder-83736 May 17 18:18:45.224758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-4bb1e553-5f25-4d96-876f-c58ec4f4f4ea req-91b965fb-9ad0-40c6-8e4a-a2b33e7dc64d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079040 May 17 18:18:45.225473 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 139/217] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:45.388318 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-524354d4-2e90-433f-8a69-3d4e74c79b50 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:45.388939 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-524354d4-2e90-433f-8a69-3d4e74c79b50 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:45.402924 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-524354d4-2e90-433f-8a69-3d4e74c79b50 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:45.403385 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-524354d4-2e90-433f-8a69-3d4e74c79b50 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:45.404174 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-524354d4-2e90-433f-8a69-3d4e74c79b50 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:45.404638 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-524354d4-2e90-433f-8a69-3d4e74c79b50 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:45.614991 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-524354d4-2e90-433f-8a69-3d4e74c79b50 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:45.623284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-524354d4-2e90-433f-8a69-3d4e74c79b50 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:45.625107 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-524354d4-2e90-433f-8a69-3d4e74c79b50 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:45.626488 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-524354d4-2e90-433f-8a69-3d4e74c79b50 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.242180 May 17 18:18:45.627765 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 79/218] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:45 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:46.093941 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-fc3c0c6d-615d-4ac9-b1f4-3b60bfe4b3d5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:46.095108 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cd59e673-9d2b-42a4-9488-537b43460956 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:46.096324 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cd59e673-9d2b-42a4-9488-537b43460956 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:46.098524 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-fc3c0c6d-615d-4ac9-b1f4-3b60bfe4b3d5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:46.119459 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fc3c0c6d-615d-4ac9-b1f4-3b60bfe4b3d5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.119459 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fc3c0c6d-615d-4ac9-b1f4-3b60bfe4b3d5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.119459 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fc3c0c6d-615d-4ac9-b1f4-3b60bfe4b3d5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.119459 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fc3c0c6d-615d-4ac9-b1f4-3b60bfe4b3d5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.129435 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd59e673-9d2b-42a4-9488-537b43460956 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.130272 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd59e673-9d2b-42a4-9488-537b43460956 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.135397 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd59e673-9d2b-42a4-9488-537b43460956 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.136207 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd59e673-9d2b-42a4-9488-537b43460956 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.167599 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cd59e673-9d2b-42a4-9488-537b43460956 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Going to try to terminate instance {{(pid=117098) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:18:46.353421 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cd59e673-9d2b-42a4-9488-537b43460956 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 204 len: 0 microversion: 2.1 time: 0.270554 May 17 18:18:46.357901 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 140/219] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:18:46 2022] DELETE /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:18:46.363795 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5bfaa380-a72c-4e02-b69e-87e5a760b40c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:46.364797 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5bfaa380-a72c-4e02-b69e-87e5a760b40c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:46.372257 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5bfaa380-a72c-4e02-b69e-87e5a760b40c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.373641 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5bfaa380-a72c-4e02-b69e-87e5a760b40c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.374700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5bfaa380-a72c-4e02-b69e-87e5a760b40c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.375142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5bfaa380-a72c-4e02-b69e-87e5a760b40c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.651490 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-fc3c0c6d-615d-4ac9-b1f4-3b60bfe4b3d5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:46.664218 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5bfaa380-a72c-4e02-b69e-87e5a760b40c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:46.668919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-fc3c0c6d-615d-4ac9-b1f4-3b60bfe4b3d5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.584453 May 17 18:18:46.669698 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 80/220] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:46 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:46.681160 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-330117fa-8f71-4bf2-a443-c9bc2a0d8f01 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:46.683954 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5bfaa380-a72c-4e02-b69e-87e5a760b40c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.324576 May 17 18:18:46.684732 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 141/221] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:46 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:46.693778 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-330117fa-8f71-4bf2-a443-c9bc2a0d8f01 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:46.699075 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ad4d83e1-995b-4183-b5e8-89d9707213df tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:46.704531 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ad4d83e1-995b-4183-b5e8-89d9707213df tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:46.709431 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-330117fa-8f71-4bf2-a443-c9bc2a0d8f01 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.709963 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-330117fa-8f71-4bf2-a443-c9bc2a0d8f01 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.712170 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-330117fa-8f71-4bf2-a443-c9bc2a0d8f01 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.712614 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-330117fa-8f71-4bf2-a443-c9bc2a0d8f01 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.717271 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad4d83e1-995b-4183-b5e8-89d9707213df tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.717767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad4d83e1-995b-4183-b5e8-89d9707213df tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.718556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad4d83e1-995b-4183-b5e8-89d9707213df tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:46.719151 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ad4d83e1-995b-4183-b5e8-89d9707213df tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:46.977286 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ad4d83e1-995b-4183-b5e8-89d9707213df tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:46.983964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-330117fa-8f71-4bf2-a443-c9bc2a0d8f01 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:46.989397 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ad4d83e1-995b-4183-b5e8-89d9707213df tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:46.991016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ad4d83e1-995b-4183-b5e8-89d9707213df tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:46.992181 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-330117fa-8f71-4bf2-a443-c9bc2a0d8f01 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1553 microversion: 2.1 time: 0.318963 May 17 18:18:46.992536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ad4d83e1-995b-4183-b5e8-89d9707213df tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1407 microversion: 2.20 time: 0.306756 May 17 18:18:46.992858 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 81/222] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:46 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1553 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:47.006905 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 142/223] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:46 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:47.687578 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7fec276b-a16c-4164-9450-f77ecf9afdcf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:47.688287 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7fec276b-a16c-4164-9450-f77ecf9afdcf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:47.695507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fec276b-a16c-4164-9450-f77ecf9afdcf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:47.695967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fec276b-a16c-4164-9450-f77ecf9afdcf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:47.696949 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fec276b-a16c-4164-9450-f77ecf9afdcf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:47.697687 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fec276b-a16c-4164-9450-f77ecf9afdcf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:47.708671 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f4a3acdd-6c25-44c2-b1e3-e282b37d4782 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:47.710835 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f4a3acdd-6c25-44c2-b1e3-e282b37d4782 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:47.721224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f4a3acdd-6c25-44c2-b1e3-e282b37d4782 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:47.722082 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f4a3acdd-6c25-44c2-b1e3-e282b37d4782 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:47.723411 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f4a3acdd-6c25-44c2-b1e3-e282b37d4782 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:47.724070 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f4a3acdd-6c25-44c2-b1e3-e282b37d4782 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:47.895537 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7fec276b-a16c-4164-9450-f77ecf9afdcf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:47.905600 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7fec276b-a16c-4164-9450-f77ecf9afdcf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.221860 May 17 18:18:47.906591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 82/224] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:47 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:47.920044 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f4a3acdd-6c25-44c2-b1e3-e282b37d4782 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:47.928550 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f4a3acdd-6c25-44c2-b1e3-e282b37d4782 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.226930 May 17 18:18:47.929102 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 143/225] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:47 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:48.011101 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c4041221-38f6-47ab-afd9-b5b2ce0c5fd9 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:48.011730 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c4041221-38f6-47ab-afd9-b5b2ce0c5fd9 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:48.017892 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4041221-38f6-47ab-afd9-b5b2ce0c5fd9 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.018632 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4041221-38f6-47ab-afd9-b5b2ce0c5fd9 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:48.019583 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4041221-38f6-47ab-afd9-b5b2ce0c5fd9 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.020014 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4041221-38f6-47ab-afd9-b5b2ce0c5fd9 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:48.025812 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5212b95a-8301-409a-a7d1-689ca89cc543 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:48.027014 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5212b95a-8301-409a-a7d1-689ca89cc543 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:48.035635 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5212b95a-8301-409a-a7d1-689ca89cc543 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.036934 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5212b95a-8301-409a-a7d1-689ca89cc543 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:48.038185 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5212b95a-8301-409a-a7d1-689ca89cc543 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.039000 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5212b95a-8301-409a-a7d1-689ca89cc543 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:48.292092 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5212b95a-8301-409a-a7d1-689ca89cc543 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:48.301391 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c4041221-38f6-47ab-afd9-b5b2ce0c5fd9 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:48.302551 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5212b95a-8301-409a-a7d1-689ca89cc543 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:48.304446 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5212b95a-8301-409a-a7d1-689ca89cc543 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:48.305944 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5212b95a-8301-409a-a7d1-689ca89cc543 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1599 microversion: 2.20 time: 0.289577 May 17 18:18:48.306676 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 144/226] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:18:48 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1599 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:18:48.310768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c4041221-38f6-47ab-afd9-b5b2ce0c5fd9 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1553 microversion: 2.1 time: 0.303569 May 17 18:18:48.311686 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 83/227] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:48 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1553 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:48.329920 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e01ff5f5-6c91-4f7e-9903-027f5f0db96f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:48.331014 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e01ff5f5-6c91-4f7e-9903-027f5f0db96f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:48.339882 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e01ff5f5-6c91-4f7e-9903-027f5f0db96f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.340340 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e01ff5f5-6c91-4f7e-9903-027f5f0db96f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:48.341173 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e01ff5f5-6c91-4f7e-9903-027f5f0db96f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.341643 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e01ff5f5-6c91-4f7e-9903-027f5f0db96f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:48.424282 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e01ff5f5-6c91-4f7e-9903-027f5f0db96f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.099969 May 17 18:18:48.424877 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 145/228] 10.222.0.65 () {60 vars in 1315 bytes} [Tue May 17 18:18:48 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:18:48.924521 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-894081fa-29c4-4c76-88e4-d4022e1c536b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:48.925781 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-894081fa-29c4-4c76-88e4-d4022e1c536b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:48.935900 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-894081fa-29c4-4c76-88e4-d4022e1c536b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.936349 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-894081fa-29c4-4c76-88e4-d4022e1c536b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:48.937121 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-894081fa-29c4-4c76-88e4-d4022e1c536b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.937582 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-894081fa-29c4-4c76-88e4-d4022e1c536b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:48.948055 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-103bf08d-4cb3-4b15-a00d-1102cda691cc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:48.950339 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-103bf08d-4cb3-4b15-a00d-1102cda691cc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:48.959623 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-103bf08d-4cb3-4b15-a00d-1102cda691cc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.960700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-103bf08d-4cb3-4b15-a00d-1102cda691cc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:48.962093 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-103bf08d-4cb3-4b15-a00d-1102cda691cc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:48.962764 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-103bf08d-4cb3-4b15-a00d-1102cda691cc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:49.420395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-894081fa-29c4-4c76-88e4-d4022e1c536b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:49.430545 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-894081fa-29c4-4c76-88e4-d4022e1c536b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1367 microversion: 2.1 time: 0.511749 May 17 18:18:49.447020 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 84/229] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:48 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1367 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:49.459472 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a2039cdb-f0c4-45ab-936f-9f8ff7d988fa tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:49.460540 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a2039cdb-f0c4-45ab-936f-9f8ff7d988fa tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:49.469530 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a2039cdb-f0c4-45ab-936f-9f8ff7d988fa tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:49.473982 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a2039cdb-f0c4-45ab-936f-9f8ff7d988fa tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:49.478314 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a2039cdb-f0c4-45ab-936f-9f8ff7d988fa tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:49.479012 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a2039cdb-f0c4-45ab-936f-9f8ff7d988fa tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:49.486818 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-103bf08d-4cb3-4b15-a00d-1102cda691cc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:49.494139 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-103bf08d-4cb3-4b15-a00d-1102cda691cc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.551787 May 17 18:18:49.494717 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 146/230] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:48 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:49.533909 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-462217716", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:49.610140 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.network.neutron [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] validate_networks() for None {{(pid=117098) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:18:49.965049 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a2039cdb-f0c4-45ab-936f-9f8ff7d988fa tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:49.979962 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a2039cdb-f0c4-45ab-936f-9f8ff7d988fa tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1553 microversion: 2.1 time: 0.530442 May 17 18:18:49.981579 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 85/231] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:49 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1553 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:50.246917 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Flavor limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:18:50.247490 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Image limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:18:50.247863 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Flavor pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:18:50.248447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Image pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:18:50.248866 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:18:50.285739 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:50.289503 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:50.293179 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:50.294382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:50.315538 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Getting quotas for project 4f60fdd09f5b450bb6cb18902bf860e0. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:18:50.323809 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Getting quotas for user c725fea1d5574c8382d3d8fb9fd61526 and project 4f60fdd09f5b450bb6cb18902bf860e0. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:18:50.329095 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-bcea82a5-b85a-42d2-9bfe-a3b2d80dbf13 req-ba37da33-59ab-4cac-ae42-3fbe3c4c0697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e", "tag": "06e106bb-68fb-497b-a3fb-dae45c0c334c"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:50.337375 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-bcea82a5-b85a-42d2-9bfe-a3b2d80dbf13 req-ba37da33-59ab-4cac-ae42-3fbe3c4c0697 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:50.337866 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-bcea82a5-b85a-42d2-9bfe-a3b2d80dbf13 req-ba37da33-59ab-4cac-ae42-3fbe3c4c0697 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:50.355926 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Going to run 1 instances... {{(pid=117098) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:18:50.358972 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:18:50.370876 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-bcea82a5-b85a-42d2-9bfe-a3b2d80dbf13 req-ba37da33-59ab-4cac-ae42-3fbe3c4c0697 service nova] Creating event network-changed:06e106bb-68fb-497b-a3fb-dae45c0c334c for instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e on hv-cinder-83736 May 17 18:18:50.381131 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-bcea82a5-b85a-42d2-9bfe-a3b2d80dbf13 req-ba37da33-59ab-4cac-ae42-3fbe3c4c0697 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055493 May 17 18:18:50.381962 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 86/232] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:50.449621 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-35aeac86-2d19-4c82-aff6-3255228561b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944298 May 17 18:18:50.450707 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 147/233] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:18:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:18:50.473434 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-bf056b29-a95f-4608-9345-801803f2328a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:50.486901 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-cc531851-3596-402e-b2fa-fa06ba23bed1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:50.488189 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-cc531851-3596-402e-b2fa-fa06ba23bed1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:50.493410 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-bf056b29-a95f-4608-9345-801803f2328a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:50.506081 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cc531851-3596-402e-b2fa-fa06ba23bed1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:50.506840 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cc531851-3596-402e-b2fa-fa06ba23bed1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:50.508501 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cc531851-3596-402e-b2fa-fa06ba23bed1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:50.509092 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cc531851-3596-402e-b2fa-fa06ba23bed1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:50.637713 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-bf056b29-a95f-4608-9345-801803f2328a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:50.647945 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-bf056b29-a95f-4608-9345-801803f2328a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1214 microversion: 2.1 time: 0.179568 May 17 18:18:50.649159 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 148/234] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:50 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1214 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:50.654702 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-47c63a54-4d10-4b15-a8c4-326a83f6eb11 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:50.657959 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-47c63a54-4d10-4b15-a8c4-326a83f6eb11 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:50.677632 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-47c63a54-4d10-4b15-a8c4-326a83f6eb11 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:50.678263 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-47c63a54-4d10-4b15-a8c4-326a83f6eb11 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:50.679460 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-47c63a54-4d10-4b15-a8c4-326a83f6eb11 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:50.680087 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-47c63a54-4d10-4b15-a8c4-326a83f6eb11 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:50.792362 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-cc531851-3596-402e-b2fa-fa06ba23bed1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:50.812966 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-cc531851-3596-402e-b2fa-fa06ba23bed1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1556 microversion: 2.1 time: 0.360672 May 17 18:18:50.815301 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 87/235] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:50 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1556 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:50.844167 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-67d8cf30-c1d5-4fa7-96ae-099d4f642c5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:50.844879 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-67d8cf30-c1d5-4fa7-96ae-099d4f642c5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:50.858089 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67d8cf30-c1d5-4fa7-96ae-099d4f642c5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:50.858772 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67d8cf30-c1d5-4fa7-96ae-099d4f642c5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:50.859799 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67d8cf30-c1d5-4fa7-96ae-099d4f642c5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:50.860442 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67d8cf30-c1d5-4fa7-96ae-099d4f642c5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:50.986207 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-67d8cf30-c1d5-4fa7-96ae-099d4f642c5c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150611 May 17 18:18:50.986787 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 88/236] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 17 18:18:50 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:18:51.000717 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b0df2695-b3b2-4b94-b0af-d3806770a752 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:51.001338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b0df2695-b3b2-4b94-b0af-d3806770a752 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:51.015353 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0df2695-b3b2-4b94-b0af-d3806770a752 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:51.016028 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0df2695-b3b2-4b94-b0af-d3806770a752 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:51.017843 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0df2695-b3b2-4b94-b0af-d3806770a752 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:51.018695 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0df2695-b3b2-4b94-b0af-d3806770a752 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:51.026093 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-47c63a54-4d10-4b15-a8c4-326a83f6eb11 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:51.039712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-47c63a54-4d10-4b15-a8c4-326a83f6eb11 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.388919 May 17 18:18:51.049089 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 149/237] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:50 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:51.397516 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b0df2695-b3b2-4b94-b0af-d3806770a752 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:51.424515 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b0df2695-b3b2-4b94-b0af-d3806770a752 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1553 microversion: 2.1 time: 0.428727 May 17 18:18:51.425423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 89/238] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:50 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1553 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:51.673947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-496b6871-859c-472f-bd75-747b4525bcdf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:51.675454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-496b6871-859c-472f-bd75-747b4525bcdf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:51.691861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-496b6871-859c-472f-bd75-747b4525bcdf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:51.694020 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-496b6871-859c-472f-bd75-747b4525bcdf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:51.696247 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-496b6871-859c-472f-bd75-747b4525bcdf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:51.700686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-496b6871-859c-472f-bd75-747b4525bcdf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:51.833977 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-496b6871-859c-472f-bd75-747b4525bcdf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:51.843292 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-496b6871-859c-472f-bd75-747b4525bcdf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1266 microversion: 2.1 time: 0.180455 May 17 18:18:51.850532 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 150/239] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:51 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:52.081891 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-db5afe29-25bb-42d5-b3df-809c25ebc64d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:52.082518 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-db5afe29-25bb-42d5-b3df-809c25ebc64d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:52.101226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-db5afe29-25bb-42d5-b3df-809c25ebc64d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:52.101775 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-db5afe29-25bb-42d5-b3df-809c25ebc64d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:52.102577 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-db5afe29-25bb-42d5-b3df-809c25ebc64d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:52.103202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-db5afe29-25bb-42d5-b3df-809c25ebc64d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:52.458862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d0cea5a4-7b84-491d-9550-11344a5e09f4 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:52.461623 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d0cea5a4-7b84-491d-9550-11344a5e09f4 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:52.480163 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d0cea5a4-7b84-491d-9550-11344a5e09f4 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:52.484118 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d0cea5a4-7b84-491d-9550-11344a5e09f4 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:52.485536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d0cea5a4-7b84-491d-9550-11344a5e09f4 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:52.487076 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d0cea5a4-7b84-491d-9550-11344a5e09f4 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:52.570862 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-db5afe29-25bb-42d5-b3df-809c25ebc64d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:52.580451 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-db5afe29-25bb-42d5-b3df-809c25ebc64d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.502415 May 17 18:18:52.581234 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 90/240] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:52 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:52.869131 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ad495d27-4595-4421-986c-105d14ef307c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:52.870178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ad495d27-4595-4421-986c-105d14ef307c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:52.877799 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ad495d27-4595-4421-986c-105d14ef307c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:52.878541 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ad495d27-4595-4421-986c-105d14ef307c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:52.879337 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ad495d27-4595-4421-986c-105d14ef307c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:52.879963 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ad495d27-4595-4421-986c-105d14ef307c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:53.039803 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ad495d27-4595-4421-986c-105d14ef307c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:53.054244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ad495d27-4595-4421-986c-105d14ef307c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1272 microversion: 2.1 time: 0.190658 May 17 18:18:53.056263 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 91/241] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:52 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:53.151656 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d0cea5a4-7b84-491d-9550-11344a5e09f4 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:53.165130 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d0cea5a4-7b84-491d-9550-11344a5e09f4 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1553 microversion: 2.1 time: 0.718895 May 17 18:18:53.165810 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 151/242] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:52 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1553 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:53.556286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-a9db648c-197b-4b5b-8a0b-8e75c0fac09c req-04d419cd-8e85-4268-bdad-c499a3b0cc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb69ecb4-59b0-447d-86ef-b0cd8ce232b3", "name": "network-vif-deleted", "tag": "72497b8a-820a-454f-9db2-9a0b38daf150"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:53.576109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-a9db648c-197b-4b5b-8a0b-8e75c0fac09c req-04d419cd-8e85-4268-bdad-c499a3b0cc35 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:53.576565 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-a9db648c-197b-4b5b-8a0b-8e75c0fac09c req-04d419cd-8e85-4268-bdad-c499a3b0cc35 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:53.597947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fa663894-6c2f-41ac-91ef-32e54a2b1797 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:53.598580 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fa663894-6c2f-41ac-91ef-32e54a2b1797 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:53.600896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-a9db648c-197b-4b5b-8a0b-8e75c0fac09c req-04d419cd-8e85-4268-bdad-c499a3b0cc35 service nova] Creating event network-vif-deleted:72497b8a-820a-454f-9db2-9a0b38daf150 for instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 on hv-cinder-83736 May 17 18:18:53.616660 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-a9db648c-197b-4b5b-8a0b-8e75c0fac09c req-04d419cd-8e85-4268-bdad-c499a3b0cc35 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064371 May 17 18:18:53.625845 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 92/243] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:53.642359 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fa663894-6c2f-41ac-91ef-32e54a2b1797 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:53.647117 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fa663894-6c2f-41ac-91ef-32e54a2b1797 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:53.652326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fa663894-6c2f-41ac-91ef-32e54a2b1797 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:53.652904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fa663894-6c2f-41ac-91ef-32e54a2b1797 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:53.946863 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fa663894-6c2f-41ac-91ef-32e54a2b1797 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:53.964115 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fa663894-6c2f-41ac-91ef-32e54a2b1797 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.370157 May 17 18:18:53.965529 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 152/244] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:53 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:54.075066 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-074e296d-17c4-4c7c-b4cd-3d9af56d2afc tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:54.076127 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-074e296d-17c4-4c7c-b4cd-3d9af56d2afc tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:54.090591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-074e296d-17c4-4c7c-b4cd-3d9af56d2afc tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:54.094453 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-074e296d-17c4-4c7c-b4cd-3d9af56d2afc tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:54.095709 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-074e296d-17c4-4c7c-b4cd-3d9af56d2afc tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:54.096359 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-074e296d-17c4-4c7c-b4cd-3d9af56d2afc tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:54.189293 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c1698a92-fed5-4aea-8567-ee45c5003e71 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:54.191706 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c1698a92-fed5-4aea-8567-ee45c5003e71 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:54.204415 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c1698a92-fed5-4aea-8567-ee45c5003e71 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:54.206690 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c1698a92-fed5-4aea-8567-ee45c5003e71 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:54.210681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c1698a92-fed5-4aea-8567-ee45c5003e71 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:54.211849 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c1698a92-fed5-4aea-8567-ee45c5003e71 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:54.279257 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c1698a92-fed5-4aea-8567-ee45c5003e71 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:54.279730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c1698a92-fed5-4aea-8567-ee45c5003e71 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:54.282163 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-c1698a92-fed5-4aea-8567-ee45c5003e71 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lazy-loading 'fault' on Instance uuid bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:18:54.376470 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c1698a92-fed5-4aea-8567-ee45c5003e71 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e64bccabbf334667a3e8de9f1b7bb878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '230486e6ce974ab89147f39cbf941839', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:54.387840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c1698a92-fed5-4aea-8567-ee45c5003e71 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 200 len: 1351 microversion: 2.1 time: 0.206286 May 17 18:18:54.388826 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 153/245] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:54 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 1351 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:54.411315 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-074e296d-17c4-4c7c-b4cd-3d9af56d2afc tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:54.422687 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-074e296d-17c4-4c7c-b4cd-3d9af56d2afc tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.354197 May 17 18:18:54.429519 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 93/246] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:54 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:54.981588 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c4b0ed88-bbfe-4cdc-aa62-c02d6a2e4f7c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:54.982931 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c4b0ed88-bbfe-4cdc-aa62-c02d6a2e4f7c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:54.990490 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c4b0ed88-bbfe-4cdc-aa62-c02d6a2e4f7c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:54.991226 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c4b0ed88-bbfe-4cdc-aa62-c02d6a2e4f7c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:54.992313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c4b0ed88-bbfe-4cdc-aa62-c02d6a2e4f7c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:54.993247 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c4b0ed88-bbfe-4cdc-aa62-c02d6a2e4f7c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:55.196533 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-e845ef75-705d-455a-aa5b-882b68f954b4 req-94b1fe4c-b2d2-4c0a-8ffc-67a9bf1717c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bdccfdf-2183-49d1-8ab7-6d7e06fffad6", "tag": "7984d267-97c2-46c7-b026-dd53166455a6"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:55.222689 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-e845ef75-705d-455a-aa5b-882b68f954b4 req-94b1fe4c-b2d2-4c0a-8ffc-67a9bf1717c8 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:55.223172 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-e845ef75-705d-455a-aa5b-882b68f954b4 req-94b1fe4c-b2d2-4c0a-8ffc-67a9bf1717c8 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:55.234048 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c4b0ed88-bbfe-4cdc-aa62-c02d6a2e4f7c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:55.245381 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c4b0ed88-bbfe-4cdc-aa62-c02d6a2e4f7c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.266772 May 17 18:18:55.248659 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-e845ef75-705d-455a-aa5b-882b68f954b4 req-94b1fe4c-b2d2-4c0a-8ffc-67a9bf1717c8 service nova] Creating event network-changed:7984d267-97c2-46c7-b026-dd53166455a6 for instance 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 on hv-cinder-83736 May 17 18:18:55.259495 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 154/247] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:54 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:55.263368 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-e845ef75-705d-455a-aa5b-882b68f954b4 req-94b1fe4c-b2d2-4c0a-8ffc-67a9bf1717c8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070901 May 17 18:18:55.264463 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 94/248] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:55.407136 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-115dfdca-092f-4fee-8376-d9d895afd458 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:55.408085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-115dfdca-092f-4fee-8376-d9d895afd458 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:55.418837 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-115dfdca-092f-4fee-8376-d9d895afd458 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:55.419583 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-115dfdca-092f-4fee-8376-d9d895afd458 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:55.421100 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-115dfdca-092f-4fee-8376-d9d895afd458 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:55.421562 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-115dfdca-092f-4fee-8376-d9d895afd458 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:55.442561 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-10a13f26-7cb1-4efe-aa2b-dd90d88e04e8 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:55.443265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-10a13f26-7cb1-4efe-aa2b-dd90d88e04e8 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:55.447121 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-115dfdca-092f-4fee-8376-d9d895afd458 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] HTTP exception thrown: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-115dfdca-092f-4fee-8376-d9d895afd458 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Request method failure captured: May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 HTTP/1.1 May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-a6z16KcEwrbD6V3gtu5NXcYvaQbrp3fw5pFLY6ptFyTNUnK30nA9fuxBrPlnKxQZrzVlTEJNn8Fw9lUjnhr7YPZu_pp954vRDFqcLI7gdguy3DrAwUTrN2RJLQvI6kJecsZJf5dyMoVWnTSYs5PUfRuwqcRCnbi1F7NQvTLlVX858 May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 230486e6ce974ab89147f39cbf941839 May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-DeleteServersTestJSON-696075475 May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:18:55.456232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_230486e6ce974ab89147f39cbf941839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/230486e6ce974ab89147f39cbf941839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/230486e6ce974ab89147f39cbf941839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/230486e6ce974ab89147f39cbf941839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-DeleteServersTestJSON-696075475 May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 230486e6ce974ab89147f39cbf941839 May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-DeleteServersTestJSON-696075475 May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-DeleteServersTestJSON-696075475-project May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: e64bccabbf334667a3e8de9f1b7bb878 May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-DeleteServersTestJSON-696075475-project May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:55.457539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': 'bb69ecb4-59b0-447d-86ef-b0cd8ce232b3'} May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:55.458242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:55.459365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:18:55.463091 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-115dfdca-092f-4fee-8376-d9d895afd458 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Returning 404 to user: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:55.468743 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-115dfdca-092f-4fee-8376-d9d895afd458 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 404 len: 111 microversion: 2.1 time: 0.063056 May 17 18:18:55.469585 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 155/249] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:55 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:55.494517 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10a13f26-7cb1-4efe-aa2b-dd90d88e04e8 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:55.494967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10a13f26-7cb1-4efe-aa2b-dd90d88e04e8 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:55.495751 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10a13f26-7cb1-4efe-aa2b-dd90d88e04e8 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:55.499852 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10a13f26-7cb1-4efe-aa2b-dd90d88e04e8 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:55.541864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-757568005", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "networks": [{"uuid": "4a6a683b-83c8-4aab-94d5-fc0e51543f48"}]}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:55.607481 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.network.neutron [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] validate_networks() for [('4a6a683b-83c8-4aab-94d5-fc0e51543f48', None, None, None, None, None)] {{(pid=117098) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:18:55.891461 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-10a13f26-7cb1-4efe-aa2b-dd90d88e04e8 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:55.899870 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-10a13f26-7cb1-4efe-aa2b-dd90d88e04e8 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.461359 May 17 18:18:55.909243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 95/250] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:55 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:55.914609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-dc116ae8-7660-4ffe-974c-f5e0a351bdb1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:55.915534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-dc116ae8-7660-4ffe-974c-f5e0a351bdb1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:55.921302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc116ae8-7660-4ffe-974c-f5e0a351bdb1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:55.921781 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc116ae8-7660-4ffe-974c-f5e0a351bdb1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:55.922549 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc116ae8-7660-4ffe-974c-f5e0a351bdb1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:55.922985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc116ae8-7660-4ffe-974c-f5e0a351bdb1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:55.937516 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-dc116ae8-7660-4ffe-974c-f5e0a351bdb1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] HTTP exception thrown: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-dc116ae8-7660-4ffe-974c-f5e0a351bdb1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Request method failure captured: May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3/os-volume_attachments HTTP/1.1 May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-a6z16KcEwrbD6V3gtu5NXcYvaQbrp3fw5pFLY6ptFyTNUnK30nA9fuxBrPlnKxQZrzVlTEJNn8Fw9lUjnhr7YPZu_pp954vRDFqcLI7gdguy3DrAwUTrN2RJLQvI6kJecsZJf5dyMoVWnTSYs5PUfRuwqcRCnbi1F7NQvTLlVX858 May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 230486e6ce974ab89147f39cbf941839 May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-DeleteServersTestJSON-696075475 May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:18:55.941543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_230486e6ce974ab89147f39cbf941839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/230486e6ce974ab89147f39cbf941839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/230486e6ce974ab89147f39cbf941839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/230486e6ce974ab89147f39cbf941839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-DeleteServersTestJSON-696075475 May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 230486e6ce974ab89147f39cbf941839 May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-DeleteServersTestJSON-696075475 May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-DeleteServersTestJSON-696075475-project May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: e64bccabbf334667a3e8de9f1b7bb878 May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-DeleteServersTestJSON-696075475-project May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:55.942934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'server_id': 'bb69ecb4-59b0-447d-86ef-b0cd8ce232b3'} May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:55.943710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:55.946032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:18:55.947607 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-dc116ae8-7660-4ffe-974c-f5e0a351bdb1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Returning 404 to user: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:55.947607 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-dc116ae8-7660-4ffe-974c-f5e0a351bdb1 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032212 May 17 18:18:55.949936 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 96/251] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:18:55 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:55.964468 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-589e1324-6ca7-432f-9dd8-f84e99f036bd req-180cae3b-85f8-44e8-b14f-ade941f071b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f92bd0-84e7-4e4f-b596-c73c9453ce85", "tag": "200d9682-a32c-4f1b-afac-5e03e64190d5"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:55.972282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-589e1324-6ca7-432f-9dd8-f84e99f036bd req-180cae3b-85f8-44e8-b14f-ade941f071b5 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:55.972728 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-589e1324-6ca7-432f-9dd8-f84e99f036bd req-180cae3b-85f8-44e8-b14f-ade941f071b5 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:55.984233 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-589e1324-6ca7-432f-9dd8-f84e99f036bd req-180cae3b-85f8-44e8-b14f-ade941f071b5 service nova] Creating event network-changed:200d9682-a32c-4f1b-afac-5e03e64190d5 for instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 on hv-cinder-83736 May 17 18:18:55.989599 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-589e1324-6ca7-432f-9dd8-f84e99f036bd req-180cae3b-85f8-44e8-b14f-ade941f071b5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030599 May 17 18:18:55.990224 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 97/252] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:56.168204 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Flavor limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:18:56.168621 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Image limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:18:56.169114 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Flavor pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:18:56.169546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Image pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:18:56.169960 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:18:56.178381 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:56.178823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:56.179665 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:56.180106 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:56.196330 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Getting quotas for project 80d1667aeb814212abe473f58d0ff420. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:18:56.200219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Getting quotas for user 8dc55bbbc4a544909a8c80d9638c3ea6 and project 80d1667aeb814212abe473f58d0ff420. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:18:56.210751 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Going to run 1 instances... {{(pid=117098) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:18:56.214026 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:18:56.261181 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-194c6eee-a0ba-4976-8a8a-5c4840f90a72 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723212 May 17 18:18:56.264909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d93fbcf4-f8c3-4698-b993-a48c5e7cfe90 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:56.265801 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 156/253] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:18:56.265912 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d93fbcf4-f8c3-4698-b993-a48c5e7cfe90 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:56.271580 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-880c8f62-8ef9-49b6-9da6-7b4fb1b38ce9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:56.274099 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-880c8f62-8ef9-49b6-9da6-7b4fb1b38ce9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:56.277520 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d93fbcf4-f8c3-4698-b993-a48c5e7cfe90 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:56.277520 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d93fbcf4-f8c3-4698-b993-a48c5e7cfe90 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:56.280888 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d93fbcf4-f8c3-4698-b993-a48c5e7cfe90 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:56.281443 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d93fbcf4-f8c3-4698-b993-a48c5e7cfe90 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:56.332411 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-880c8f62-8ef9-49b6-9da6-7b4fb1b38ce9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:56.340641 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-880c8f62-8ef9-49b6-9da6-7b4fb1b38ce9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1218 microversion: 2.1 time: 0.072855 May 17 18:18:56.342602 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 157/254] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:56 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:56.444702 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d93fbcf4-f8c3-4698-b993-a48c5e7cfe90 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:56.453099 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d93fbcf4-f8c3-4698-b993-a48c5e7cfe90 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.192823 May 17 18:18:56.453702 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 98/255] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:56 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:56.916712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-579b349f-2ceb-4431-ab6f-af5401c276f1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:56.917331 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-579b349f-2ceb-4431-ab6f-af5401c276f1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:56.923385 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-579b349f-2ceb-4431-ab6f-af5401c276f1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:56.923837 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-579b349f-2ceb-4431-ab6f-af5401c276f1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:56.924606 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-579b349f-2ceb-4431-ab6f-af5401c276f1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:56.925046 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-579b349f-2ceb-4431-ab6f-af5401c276f1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:57.054231 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-579b349f-2ceb-4431-ab6f-af5401c276f1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:57.064636 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-579b349f-2ceb-4431-ab6f-af5401c276f1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.151685 May 17 18:18:57.065123 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 158/256] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:56 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:57.152378 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-76ffe3e1-a82e-4ba2-8570-76ca578b4d27 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:57.152870 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-76ffe3e1-a82e-4ba2-8570-76ca578b4d27 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:57.158818 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76ffe3e1-a82e-4ba2-8570-76ca578b4d27 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:57.159262 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76ffe3e1-a82e-4ba2-8570-76ca578b4d27 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:57.160017 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76ffe3e1-a82e-4ba2-8570-76ca578b4d27 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:57.160453 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76ffe3e1-a82e-4ba2-8570-76ca578b4d27 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:57.173871 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-76ffe3e1-a82e-4ba2-8570-76ca578b4d27 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] HTTP exception thrown: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-76ffe3e1-a82e-4ba2-8570-76ca578b4d27 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Request method failure captured: May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: DELETE /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 HTTP/1.1 May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-a6z16KcEwrbD6V3gtu5NXcYvaQbrp3fw5pFLY6ptFyTNUnK30nA9fuxBrPlnKxQZrzVlTEJNn8Fw9lUjnhr7YPZu_pp954vRDFqcLI7gdguy3DrAwUTrN2RJLQvI6kJecsZJf5dyMoVWnTSYs5PUfRuwqcRCnbi1F7NQvTLlVX858 May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 230486e6ce974ab89147f39cbf941839 May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-DeleteServersTestJSON-696075475 May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:18:57.176108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_230486e6ce974ab89147f39cbf941839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/230486e6ce974ab89147f39cbf941839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/230486e6ce974ab89147f39cbf941839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/230486e6ce974ab89147f39cbf941839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-DeleteServersTestJSON-696075475 May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 230486e6ce974ab89147f39cbf941839 May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-DeleteServersTestJSON-696075475 May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-DeleteServersTestJSON-696075475-project May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: e64bccabbf334667a3e8de9f1b7bb878 May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-DeleteServersTestJSON-696075475-project May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:57.177762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': 'bb69ecb4-59b0-447d-86ef-b0cd8ce232b3'} May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:57.178754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:57.180612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:18:57.181878 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-76ffe3e1-a82e-4ba2-8570-76ca578b4d27 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Returning 404 to user: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:57.181878 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-76ffe3e1-a82e-4ba2-8570-76ca578b4d27 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "DELETE /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 404 len: 111 microversion: 2.1 time: 0.028972 May 17 18:18:57.181878 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 99/257] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:18:57 2022] DELETE /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:57.186536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3beccf0c-8011-4ede-a079-d3635096bed5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:57.187142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3beccf0c-8011-4ede-a079-d3635096bed5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] [instance: bb69ecb4-59b0-447d-86ef-b0cd8ce232b3] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:57.193246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3beccf0c-8011-4ede-a079-d3635096bed5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:57.193723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3beccf0c-8011-4ede-a079-d3635096bed5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:57.194494 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3beccf0c-8011-4ede-a079-d3635096bed5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:57.195006 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3beccf0c-8011-4ede-a079-d3635096bed5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:57.209033 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-3beccf0c-8011-4ede-a079-d3635096bed5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] HTTP exception thrown: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3beccf0c-8011-4ede-a079-d3635096bed5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Request method failure captured: May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 HTTP/1.1 May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-a6z16KcEwrbD6V3gtu5NXcYvaQbrp3fw5pFLY6ptFyTNUnK30nA9fuxBrPlnKxQZrzVlTEJNn8Fw9lUjnhr7YPZu_pp954vRDFqcLI7gdguy3DrAwUTrN2RJLQvI6kJecsZJf5dyMoVWnTSYs5PUfRuwqcRCnbi1F7NQvTLlVX858 May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 230486e6ce974ab89147f39cbf941839 May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-DeleteServersTestJSON-696075475 May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:18:57.210577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_230486e6ce974ab89147f39cbf941839"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/230486e6ce974ab89147f39cbf941839"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/230486e6ce974ab89147f39cbf941839"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/230486e6ce974ab89147f39cbf941839"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-DeleteServersTestJSON-696075475 May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 230486e6ce974ab89147f39cbf941839 May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-DeleteServersTestJSON-696075475 May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-DeleteServersTestJSON-696075475-project May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: e64bccabbf334667a3e8de9f1b7bb878 May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-DeleteServersTestJSON-696075475-project May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:57.212066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': 'bb69ecb4-59b0-447d-86ef-b0cd8ce232b3'} May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:18:57.212763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. May 17 18:18:57.213857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:18:57.215251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3beccf0c-8011-4ede-a079-d3635096bed5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] Returning 404 to user: Instance bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:18:57.215251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3beccf0c-8011-4ede-a079-d3635096bed5 tempest-DeleteServersTestJSON-696075475 tempest-DeleteServersTestJSON-696075475-project] 10.222.0.65 "GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3" status: 404 len: 111 microversion: 2.1 time: 0.029298 May 17 18:18:57.215251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 159/258] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:57 2022] GET /compute/v2.1/servers/bb69ecb4-59b0-447d-86ef-b0cd8ce232b3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:18:57.362253 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-696047cd-366d-440a-b4af-d096ead39855 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:57.363395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-696047cd-366d-440a-b4af-d096ead39855 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:57.374461 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-696047cd-366d-440a-b4af-d096ead39855 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:57.374932 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-696047cd-366d-440a-b4af-d096ead39855 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:57.375727 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-696047cd-366d-440a-b4af-d096ead39855 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:57.376171 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-696047cd-366d-440a-b4af-d096ead39855 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:57.460162 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-696047cd-366d-440a-b4af-d096ead39855 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:57.470206 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-696047cd-366d-440a-b4af-d096ead39855 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1222 microversion: 2.1 time: 0.114143 May 17 18:18:57.470561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3fad4d98-2383-487e-82f1-128689f89c5d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:57.471197 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3fad4d98-2383-487e-82f1-128689f89c5d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:57.480749 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 100/259] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:57 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:57.486280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3fad4d98-2383-487e-82f1-128689f89c5d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:57.486935 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3fad4d98-2383-487e-82f1-128689f89c5d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:57.487712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3fad4d98-2383-487e-82f1-128689f89c5d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:57.488147 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3fad4d98-2383-487e-82f1-128689f89c5d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:57.850190 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3fad4d98-2383-487e-82f1-128689f89c5d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:57.859012 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3fad4d98-2383-487e-82f1-128689f89c5d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.392216 May 17 18:18:57.859582 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 160/260] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:57 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:18:58.082136 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d2bc7f29-f07f-45c2-8b5a-7abc0e1d9944 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:58.082762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d2bc7f29-f07f-45c2-8b5a-7abc0e1d9944 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:58.089142 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d2bc7f29-f07f-45c2-8b5a-7abc0e1d9944 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:58.089634 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d2bc7f29-f07f-45c2-8b5a-7abc0e1d9944 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:58.090407 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d2bc7f29-f07f-45c2-8b5a-7abc0e1d9944 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:58.090854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d2bc7f29-f07f-45c2-8b5a-7abc0e1d9944 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:58.284421 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d2bc7f29-f07f-45c2-8b5a-7abc0e1d9944 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:58.292549 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d2bc7f29-f07f-45c2-8b5a-7abc0e1d9944 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.214207 May 17 18:18:58.293329 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 101/261] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:58 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:58.487791 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2a667a79-26bd-4dba-8617-42ab4bb42943 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:58.488401 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2a667a79-26bd-4dba-8617-42ab4bb42943 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:58.494705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a667a79-26bd-4dba-8617-42ab4bb42943 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:58.495152 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a667a79-26bd-4dba-8617-42ab4bb42943 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:58.495971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a667a79-26bd-4dba-8617-42ab4bb42943 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:58.496341 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2a667a79-26bd-4dba-8617-42ab4bb42943 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:58.560056 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2a667a79-26bd-4dba-8617-42ab4bb42943 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:58.567455 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2a667a79-26bd-4dba-8617-42ab4bb42943 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1222 microversion: 2.1 time: 0.083512 May 17 18:18:58.568012 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 161/262] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:58 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:58.875906 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1dea57c4-8bf5-458c-ae10-030b0dba29c1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:58.877785 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1dea57c4-8bf5-458c-ae10-030b0dba29c1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:58.893325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1dea57c4-8bf5-458c-ae10-030b0dba29c1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:58.894004 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1dea57c4-8bf5-458c-ae10-030b0dba29c1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:58.894876 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1dea57c4-8bf5-458c-ae10-030b0dba29c1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:58.895374 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1dea57c4-8bf5-458c-ae10-030b0dba29c1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:59.112839 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1dea57c4-8bf5-458c-ae10-030b0dba29c1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:59.121009 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1dea57c4-8bf5-458c-ae10-030b0dba29c1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.249023 May 17 18:18:59.121619 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 102/263] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:58 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:59.197503 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d20e2d88-290b-42cf-ad3a-efff036fcd20 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Action: 'create', calling method: .version_select at 0x7f4e61c3d160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2072484535"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:18:59.309980 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-280e8e8c-26a4-464b-988a-28142f55b070 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:59.311242 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-280e8e8c-26a4-464b-988a-28142f55b070 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:59.322018 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-280e8e8c-26a4-464b-988a-28142f55b070 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:59.322963 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-280e8e8c-26a4-464b-988a-28142f55b070 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:59.324198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-280e8e8c-26a4-464b-988a-28142f55b070 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:59.324910 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-280e8e8c-26a4-464b-988a-28142f55b070 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:59.646085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d20e2d88-290b-42cf-ad3a-efff036fcd20 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.560731 May 17 18:18:59.655446 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 162/264] 10.222.0.65 () {60 vars in 1154 bytes} [Tue May 17 18:18:59 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 571 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) May 17 18:18:59.663142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-608a5e4a-648a-456a-9e4f-92c8ac000bb8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:59.665881 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-608a5e4a-648a-456a-9e4f-92c8ac000bb8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:18:59.687909 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-608a5e4a-648a-456a-9e4f-92c8ac000bb8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:59.692029 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-608a5e4a-648a-456a-9e4f-92c8ac000bb8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:59.694037 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-608a5e4a-648a-456a-9e4f-92c8ac000bb8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:18:59.694849 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-608a5e4a-648a-456a-9e4f-92c8ac000bb8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:18:59.717971 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-280e8e8c-26a4-464b-988a-28142f55b070 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:59.725799 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-280e8e8c-26a4-464b-988a-28142f55b070 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.420129 May 17 18:18:59.729734 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 103/265] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:59 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:18:59.747015 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b78a0071-28da-44e7-a148-82571c5ecc11 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e605efe50>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:18:59.818022 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b78a0071-28da-44e7-a148-82571c5ecc11 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b" status: 200 len: 345 microversion: 2.1 time: 0.086694 May 17 18:18:59.818940 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 104/266] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:18:59 2022] GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b => generated 345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:18:59.860432 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-608a5e4a-648a-456a-9e4f-92c8ac000bb8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:18:59.868975 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-608a5e4a-648a-456a-9e4f-92c8ac000bb8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1288 microversion: 2.1 time: 0.212007 May 17 18:18:59.869552 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 163/267] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:18:59 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1288 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:00.138909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d0d97238-cbda-44b2-9719-45633008a8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:00.139523 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d0d97238-cbda-44b2-9719-45633008a8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:00.145972 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d0d97238-cbda-44b2-9719-45633008a8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:00.146678 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d0d97238-cbda-44b2-9719-45633008a8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:00.147768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d0d97238-cbda-44b2-9719-45633008a8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:00.148225 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d0d97238-cbda-44b2-9719-45633008a8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:00.296628 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d0d97238-cbda-44b2-9719-45633008a8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:00.304145 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d0d97238-cbda-44b2-9719-45633008a8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.169558 May 17 18:19:00.305370 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 105/268] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:00 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:00.747390 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6fa6c445-b8aa-4138-9eda-70ae369fc68a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:00.748035 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6fa6c445-b8aa-4138-9eda-70ae369fc68a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:00.753983 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6fa6c445-b8aa-4138-9eda-70ae369fc68a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:00.754441 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6fa6c445-b8aa-4138-9eda-70ae369fc68a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:00.755561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6fa6c445-b8aa-4138-9eda-70ae369fc68a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:00.756024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6fa6c445-b8aa-4138-9eda-70ae369fc68a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:00.845617 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a9029d73-394b-41f2-bdde-510f3ed51d8f tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e605a9af0>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:00.897830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a9029d73-394b-41f2-bdde-510f3ed51d8f tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b" status: 200 len: 346 microversion: 2.1 time: 0.070128 May 17 18:19:00.899108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 106/269] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:19:00 2022] GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b => generated 346 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:19:00.903641 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7b1e8147-447d-4f2b-a7c2-cecd2ab86d15 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:00.904431 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7b1e8147-447d-4f2b-a7c2-cecd2ab86d15 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:00.911613 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b1e8147-447d-4f2b-a7c2-cecd2ab86d15 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:00.912314 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b1e8147-447d-4f2b-a7c2-cecd2ab86d15 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:00.913508 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b1e8147-447d-4f2b-a7c2-cecd2ab86d15 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:00.914118 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b1e8147-447d-4f2b-a7c2-cecd2ab86d15 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:00.916386 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6fa6c445-b8aa-4138-9eda-70ae369fc68a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:00.928432 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6fa6c445-b8aa-4138-9eda-70ae369fc68a tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.186061 May 17 18:19:00.929373 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 164/270] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:00 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:00.935350 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c90a3f6d-affa-491b-b75e-9e4c279871ed tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Action: 'create', calling method: .version_select at 0x7f4e5b5e7dc0>, body: {"snapshot": {"volume_id": "570cb021-b443-4cc9-865c-8ff05cff5b4b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-122298547"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:01.092861 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7b1e8147-447d-4f2b-a7c2-cecd2ab86d15 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:01.102034 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7b1e8147-447d-4f2b-a7c2-cecd2ab86d15 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.202047 May 17 18:19:01.102611 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 107/271] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:00 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:01.112455 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c90a3f6d-affa-491b-b75e-9e4c279871ed tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.181651 May 17 18:19:01.113041 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 165/272] 10.222.0.65 () {60 vars in 1161 bytes} [Tue May 17 18:19:00 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:01.117217 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-c157dd74-32a5-4ef4-b6f9-6a4269f0b482 req-cfacd27b-8b14-44db-b7a6-edff48eefda7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec13a585-cf06-497f-8381-d90b5531f029", "tag": "46b16982-1e63-43c1-a0be-4dfa4d935943"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:01.123187 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f8e1eeda-e9d1-4d3e-8b32-0af5ca122dd5 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e5b58cee0>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:01.148786 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-c157dd74-32a5-4ef4-b6f9-6a4269f0b482 req-cfacd27b-8b14-44db-b7a6-edff48eefda7 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.150336 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-c157dd74-32a5-4ef4-b6f9-6a4269f0b482 req-cfacd27b-8b14-44db-b7a6-edff48eefda7 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:01.157857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f8e1eeda-e9d1-4d3e-8b32-0af5ca122dd5 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a" status: 200 len: 286 microversion: 2.1 time: 0.038848 May 17 18:19:01.161904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 166/273] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 17 18:19:01 2022] GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:01.164400 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-c157dd74-32a5-4ef4-b6f9-6a4269f0b482 req-cfacd27b-8b14-44db-b7a6-edff48eefda7 service nova] Creating event network-changed:46b16982-1e63-43c1-a0be-4dfa4d935943 for instance ec13a585-cf06-497f-8381-d90b5531f029 on hv-cinder-83736 May 17 18:19:01.169676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-c157dd74-32a5-4ef4-b6f9-6a4269f0b482 req-cfacd27b-8b14-44db-b7a6-edff48eefda7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065542 May 17 18:19:01.170076 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e4bd7396-8844-4ed9-842b-d48db8ecde44 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e5b58bd30>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:01.170357 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 108/274] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:01.201570 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e4bd7396-8844-4ed9-842b-d48db8ecde44 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.037197 May 17 18:19:01.202135 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 167/275] 10.222.0.65 () {58 vars in 1139 bytes} [Tue May 17 18:19:01 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:19:01.215956 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b348bccb-da4c-4275-9fd3-32896e0f8d88 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e605a9310>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:01.247949 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b348bccb-da4c-4275-9fd3-32896e0f8d88 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a" status: 200 len: 286 microversion: 2.1 time: 0.038147 May 17 18:19:01.248685 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 109/276] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 17 18:19:01 2022] GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:19:01.321698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fb20a731-a90d-4059-ab7b-67f9415ee013 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:01.322347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fb20a731-a90d-4059-ab7b-67f9415ee013 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:01.328590 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fb20a731-a90d-4059-ab7b-67f9415ee013 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.329052 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fb20a731-a90d-4059-ab7b-67f9415ee013 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:01.329857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fb20a731-a90d-4059-ab7b-67f9415ee013 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.330300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fb20a731-a90d-4059-ab7b-67f9415ee013 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:01.461519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fb20a731-a90d-4059-ab7b-67f9415ee013 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:01.469419 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fb20a731-a90d-4059-ab7b-67f9415ee013 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.152318 May 17 18:19:01.470024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 168/277] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:01 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:01.677276 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-6abe81f8-4dce-4034-a663-10f2f6a37e31 req-62cdd2d4-396d-4613-86a5-8069271ba5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdccfdf-2183-49d1-8ab7-6d7e06fffad6", "name": "network-vif-plugged", "status": "completed", "tag": "7984d267-97c2-46c7-b026-dd53166455a6"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:01.686477 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-6abe81f8-4dce-4034-a663-10f2f6a37e31 req-62cdd2d4-396d-4613-86a5-8069271ba5d5 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.686960 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-6abe81f8-4dce-4034-a663-10f2f6a37e31 req-62cdd2d4-396d-4613-86a5-8069271ba5d5 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:01.699029 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-6abe81f8-4dce-4034-a663-10f2f6a37e31 req-62cdd2d4-396d-4613-86a5-8069271ba5d5 service nova] Creating event network-vif-plugged:7984d267-97c2-46c7-b026-dd53166455a6 for instance 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 on hv-cinder-83736 May 17 18:19:01.703631 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-6abe81f8-4dce-4034-a663-10f2f6a37e31 req-62cdd2d4-396d-4613-86a5-8069271ba5d5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030108 May 17 18:19:01.704290 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 110/278] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:01.945945 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c41c5e95-a9f4-488b-baa7-d202985625f9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:01.946560 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c41c5e95-a9f4-488b-baa7-d202985625f9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:01.952783 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c41c5e95-a9f4-488b-baa7-d202985625f9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.953231 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c41c5e95-a9f4-488b-baa7-d202985625f9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:01.954032 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c41c5e95-a9f4-488b-baa7-d202985625f9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:01.954469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c41c5e95-a9f4-488b-baa7-d202985625f9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:02.081640 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c41c5e95-a9f4-488b-baa7-d202985625f9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:02.089582 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c41c5e95-a9f4-488b-baa7-d202985625f9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.147702 May 17 18:19:02.090144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 169/279] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:01 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:02.119564 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-60bef154-5358-4fdc-bce1-e47497dc5349 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:02.120271 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-60bef154-5358-4fdc-bce1-e47497dc5349 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:02.126374 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-60bef154-5358-4fdc-bce1-e47497dc5349 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:02.126835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-60bef154-5358-4fdc-bce1-e47497dc5349 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:02.127606 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-60bef154-5358-4fdc-bce1-e47497dc5349 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:02.128054 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-60bef154-5358-4fdc-bce1-e47497dc5349 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:02.253581 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-60bef154-5358-4fdc-bce1-e47497dc5349 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:02.259444 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e3470875-9c56-490a-8a59-9b531f106560 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e61c3d160>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:02.260999 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-60bef154-5358-4fdc-bce1-e47497dc5349 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.145619 May 17 18:19:02.261596 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 111/280] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:02 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:02.287773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e3470875-9c56-490a-8a59-9b531f106560 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a" status: 200 len: 286 microversion: 2.1 time: 0.032011 May 17 18:19:02.288350 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 170/281] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 17 18:19:02 2022] GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:19:02.486449 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7c54af6c-8002-4d97-8b5a-4adae7d3332e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:02.487064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7c54af6c-8002-4d97-8b5a-4adae7d3332e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:02.493425 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7c54af6c-8002-4d97-8b5a-4adae7d3332e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:02.493907 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7c54af6c-8002-4d97-8b5a-4adae7d3332e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:02.494678 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7c54af6c-8002-4d97-8b5a-4adae7d3332e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:02.495115 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7c54af6c-8002-4d97-8b5a-4adae7d3332e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:02.629454 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7c54af6c-8002-4d97-8b5a-4adae7d3332e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:02.636715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7c54af6c-8002-4d97-8b5a-4adae7d3332e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.154207 May 17 18:19:02.637295 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 112/282] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:02 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:03.106770 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-02529188-2f88-4323-b9b2-6336239a2053 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:03.107325 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-02529188-2f88-4323-b9b2-6336239a2053 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:03.113274 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-02529188-2f88-4323-b9b2-6336239a2053 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:03.113756 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-02529188-2f88-4323-b9b2-6336239a2053 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:03.114544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-02529188-2f88-4323-b9b2-6336239a2053 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:03.114975 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-02529188-2f88-4323-b9b2-6336239a2053 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:03.238912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-02529188-2f88-4323-b9b2-6336239a2053 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:03.246418 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-02529188-2f88-4323-b9b2-6336239a2053 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.143562 May 17 18:19:03.246983 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 171/283] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:03 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:03.278302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-25f0a747-3664-4e5c-b5f3-0d5715903ba2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:03.278915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-25f0a747-3664-4e5c-b5f3-0d5715903ba2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:03.285283 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-25f0a747-3664-4e5c-b5f3-0d5715903ba2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:03.285757 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-25f0a747-3664-4e5c-b5f3-0d5715903ba2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:03.286512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-25f0a747-3664-4e5c-b5f3-0d5715903ba2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:03.286943 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-25f0a747-3664-4e5c-b5f3-0d5715903ba2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:03.299868 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e5a0a019-5f52-4927-9c18-ac32ff3ec573 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e5b5e7f70>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:03.329312 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e5a0a019-5f52-4927-9c18-ac32ff3ec573 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a" status: 200 len: 286 microversion: 2.1 time: 0.033187 May 17 18:19:03.329912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 172/284] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 17 18:19:03 2022] GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:19:03.411011 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-25f0a747-3664-4e5c-b5f3-0d5715903ba2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:03.418289 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-25f0a747-3664-4e5c-b5f3-0d5715903ba2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.143800 May 17 18:19:03.418853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 113/285] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:03 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:03.652783 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1788b39b-d0cb-4ff2-869f-2168f25c3a18 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:03.653401 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1788b39b-d0cb-4ff2-869f-2168f25c3a18 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:03.659368 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1788b39b-d0cb-4ff2-869f-2168f25c3a18 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:03.659823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1788b39b-d0cb-4ff2-869f-2168f25c3a18 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:03.660596 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1788b39b-d0cb-4ff2-869f-2168f25c3a18 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:03.661032 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1788b39b-d0cb-4ff2-869f-2168f25c3a18 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:03.788779 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1788b39b-d0cb-4ff2-869f-2168f25c3a18 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:03.796080 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1788b39b-d0cb-4ff2-869f-2168f25c3a18 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.147159 May 17 18:19:03.796639 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 173/286] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:03 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:04.263097 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-15cd7ed9-7340-449c-9b92-ab613352bb3c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:04.263711 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-15cd7ed9-7340-449c-9b92-ab613352bb3c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:04.269624 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-15cd7ed9-7340-449c-9b92-ab613352bb3c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:04.270074 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-15cd7ed9-7340-449c-9b92-ab613352bb3c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:04.270826 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-15cd7ed9-7340-449c-9b92-ab613352bb3c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:04.271263 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-15cd7ed9-7340-449c-9b92-ab613352bb3c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:04.340707 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7ba0ae4d-41d4-45a1-95ef-a5d1a1b22190 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e61c3df70>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:04.370944 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7ba0ae4d-41d4-45a1-95ef-a5d1a1b22190 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a" status: 200 len: 286 microversion: 2.1 time: 0.033998 May 17 18:19:04.371516 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 174/287] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 17 18:19:04 2022] GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:19:04.399724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-15cd7ed9-7340-449c-9b92-ab613352bb3c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:04.407051 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-15cd7ed9-7340-449c-9b92-ab613352bb3c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.147856 May 17 18:19:04.407617 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 114/288] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:04 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:04.434776 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-eb2c8963-dd27-4110-9c36-77a8c22981b5 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:04.435419 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-eb2c8963-dd27-4110-9c36-77a8c22981b5 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:04.441334 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-eb2c8963-dd27-4110-9c36-77a8c22981b5 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:04.441822 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-eb2c8963-dd27-4110-9c36-77a8c22981b5 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:04.442587 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-eb2c8963-dd27-4110-9c36-77a8c22981b5 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:04.443024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-eb2c8963-dd27-4110-9c36-77a8c22981b5 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:04.568596 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-eb2c8963-dd27-4110-9c36-77a8c22981b5 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:04.576204 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-eb2c8963-dd27-4110-9c36-77a8c22981b5 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.145233 May 17 18:19:04.576768 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 175/289] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:04 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:04.813412 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-023a435e-0d20-4d4f-bb78-3e1fb193fbfc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:04.813990 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-023a435e-0d20-4d4f-bb78-3e1fb193fbfc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:04.820506 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-023a435e-0d20-4d4f-bb78-3e1fb193fbfc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:04.820964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-023a435e-0d20-4d4f-bb78-3e1fb193fbfc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:04.821760 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-023a435e-0d20-4d4f-bb78-3e1fb193fbfc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:04.822199 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-023a435e-0d20-4d4f-bb78-3e1fb193fbfc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:04.945637 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-023a435e-0d20-4d4f-bb78-3e1fb193fbfc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:04.953291 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-023a435e-0d20-4d4f-bb78-3e1fb193fbfc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.143852 May 17 18:19:04.953890 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 115/290] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:04 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:05.383178 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d32ebb57-893e-47b6-8f75-74f7fd40a9de tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e5b776280>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:05.411328 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d32ebb57-893e-47b6-8f75-74f7fd40a9de tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a" status: 200 len: 286 microversion: 2.1 time: 0.032562 May 17 18:19:05.411956 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 176/291] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 17 18:19:05 2022] GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a => generated 286 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:19:05.423798 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c2b03360-c1d5-47ec-b736-170f24fe5002 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:05.424439 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c2b03360-c1d5-47ec-b736-170f24fe5002 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:05.431388 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c2b03360-c1d5-47ec-b736-170f24fe5002 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:05.431835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c2b03360-c1d5-47ec-b736-170f24fe5002 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:05.432591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c2b03360-c1d5-47ec-b736-170f24fe5002 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:05.433029 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c2b03360-c1d5-47ec-b736-170f24fe5002 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:05.560504 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c2b03360-c1d5-47ec-b736-170f24fe5002 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:05.567770 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c2b03360-c1d5-47ec-b736-170f24fe5002 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.147725 May 17 18:19:05.568565 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 116/292] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:05 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:05.592671 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-925ca70a-6be7-418c-8dd7-26652bf5a9c2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:05.593287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-925ca70a-6be7-418c-8dd7-26652bf5a9c2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:05.599130 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-925ca70a-6be7-418c-8dd7-26652bf5a9c2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:05.599584 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-925ca70a-6be7-418c-8dd7-26652bf5a9c2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:05.600357 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-925ca70a-6be7-418c-8dd7-26652bf5a9c2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:05.600797 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-925ca70a-6be7-418c-8dd7-26652bf5a9c2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:05.728556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-925ca70a-6be7-418c-8dd7-26652bf5a9c2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:05.735840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-925ca70a-6be7-418c-8dd7-26652bf5a9c2 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.147058 May 17 18:19:05.736396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 177/293] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:05 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:05.970606 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5412d3ff-f73a-49a6-b6a4-89ddbcc3d2b9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:05.971222 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5412d3ff-f73a-49a6-b6a4-89ddbcc3d2b9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:05.977914 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5412d3ff-f73a-49a6-b6a4-89ddbcc3d2b9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:05.978368 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5412d3ff-f73a-49a6-b6a4-89ddbcc3d2b9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:05.979139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5412d3ff-f73a-49a6-b6a4-89ddbcc3d2b9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:05.979581 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5412d3ff-f73a-49a6-b6a4-89ddbcc3d2b9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:06.104792 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5412d3ff-f73a-49a6-b6a4-89ddbcc3d2b9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:06.112042 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5412d3ff-f73a-49a6-b6a4-89ddbcc3d2b9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.145279 May 17 18:19:06.112601 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 117/294] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:05 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:06.423556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-988373f1-3bfd-4211-932d-49a1927530ca tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e5b776e50>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:06.451883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-988373f1-3bfd-4211-932d-49a1927530ca tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a" status: 200 len: 286 microversion: 2.1 time: 0.032126 May 17 18:19:06.452413 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 178/295] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 17 18:19:06 2022] GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:06.584284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-203476c7-5e49-46d7-a306-e4e6870310e9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:06.584935 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-203476c7-5e49-46d7-a306-e4e6870310e9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:06.591352 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-203476c7-5e49-46d7-a306-e4e6870310e9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:06.591810 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-203476c7-5e49-46d7-a306-e4e6870310e9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:06.592579 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-203476c7-5e49-46d7-a306-e4e6870310e9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:06.593022 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-203476c7-5e49-46d7-a306-e4e6870310e9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:06.722813 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-203476c7-5e49-46d7-a306-e4e6870310e9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:06.730097 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-203476c7-5e49-46d7-a306-e4e6870310e9 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.149881 May 17 18:19:06.730662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 118/296] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:06 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:06.752697 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2197401c-2493-4cad-914d-37bbb9d011bb tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:06.753304 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2197401c-2493-4cad-914d-37bbb9d011bb tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:06.759846 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2197401c-2493-4cad-914d-37bbb9d011bb tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:06.760286 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2197401c-2493-4cad-914d-37bbb9d011bb tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:06.761039 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2197401c-2493-4cad-914d-37bbb9d011bb tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:06.761489 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2197401c-2493-4cad-914d-37bbb9d011bb tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:06.886777 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2197401c-2493-4cad-914d-37bbb9d011bb tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:06.893903 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2197401c-2493-4cad-914d-37bbb9d011bb tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.145008 May 17 18:19:06.894459 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 179/297] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:06 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:07.128651 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c147395f-799d-4d22-806a-7007780afa47 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:07.129273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c147395f-799d-4d22-806a-7007780afa47 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:07.135736 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c147395f-799d-4d22-806a-7007780afa47 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:07.136204 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c147395f-799d-4d22-806a-7007780afa47 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:07.136963 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c147395f-799d-4d22-806a-7007780afa47 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:07.137411 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c147395f-799d-4d22-806a-7007780afa47 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:07.266382 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c147395f-799d-4d22-806a-7007780afa47 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:07.273683 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c147395f-799d-4d22-806a-7007780afa47 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.148885 May 17 18:19:07.274259 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 119/298] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:07 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:07.463466 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-84bed64f-bd25-49c5-9711-bfab699152ab tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e5b7761f0>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:07.493018 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-84bed64f-bd25-49c5-9711-bfab699152ab tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a" status: 200 len: 287 microversion: 2.1 time: 0.033388 May 17 18:19:07.493614 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 180/299] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 17 18:19:07 2022] GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:07.503529 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-47b0ba08-e8d1-4a71-8322-11119c8f0521 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e60596940>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:07.560231 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-47b0ba08-e8d1-4a71-8322-11119c8f0521 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "DELETE /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a" status: 202 len: 0 microversion: 2.1 time: 0.060207 May 17 18:19:07.561323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 120/300] 10.222.0.65 () {58 vars in 1253 bytes} [Tue May 17 18:19:07 2022] DELETE /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:19:07.569640 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-dd3261af-ea89-4724-944b-ec85e2526ac6 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e5b58b040>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:07.598113 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-dd3261af-ea89-4724-944b-ec85e2526ac6 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a" status: 200 len: 286 microversion: 2.1 time: 0.032312 May 17 18:19:07.598695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 181/301] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 17 18:19:07 2022] GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a => generated 286 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:07.748272 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-83ef3c5c-fd17-40d8-b440-5164e4752516 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:07.748990 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-83ef3c5c-fd17-40d8-b440-5164e4752516 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:07.755662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83ef3c5c-fd17-40d8-b440-5164e4752516 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:07.756212 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83ef3c5c-fd17-40d8-b440-5164e4752516 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:07.757055 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83ef3c5c-fd17-40d8-b440-5164e4752516 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:07.757564 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83ef3c5c-fd17-40d8-b440-5164e4752516 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:07.883378 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-83ef3c5c-fd17-40d8-b440-5164e4752516 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:07.890510 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-83ef3c5c-fd17-40d8-b440-5164e4752516 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.146502 May 17 18:19:07.891107 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 121/302] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:07 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:07.910404 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-80279006-e26f-4425-83db-875e5c4aa0dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:07.911056 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-80279006-e26f-4425-83db-875e5c4aa0dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:07.918128 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-80279006-e26f-4425-83db-875e5c4aa0dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:07.918585 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-80279006-e26f-4425-83db-875e5c4aa0dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:07.919352 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-80279006-e26f-4425-83db-875e5c4aa0dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:07.919790 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-80279006-e26f-4425-83db-875e5c4aa0dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:08.044421 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-80279006-e26f-4425-83db-875e5c4aa0dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:08.051611 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-80279006-e26f-4425-83db-875e5c4aa0dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.145025 May 17 18:19:08.052166 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 182/303] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:07 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:08.291492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-958d7dcf-13e9-4a2d-a073-a73004e1fbb8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:08.292055 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-958d7dcf-13e9-4a2d-a073-a73004e1fbb8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:08.297900 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-958d7dcf-13e9-4a2d-a073-a73004e1fbb8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:08.298349 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-958d7dcf-13e9-4a2d-a073-a73004e1fbb8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:08.299142 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-958d7dcf-13e9-4a2d-a073-a73004e1fbb8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:08.299581 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-958d7dcf-13e9-4a2d-a073-a73004e1fbb8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:08.425620 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-958d7dcf-13e9-4a2d-a073-a73004e1fbb8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:08.433197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-958d7dcf-13e9-4a2d-a073-a73004e1fbb8 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.146550 May 17 18:19:08.433797 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 122/304] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:08 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:08.609786 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e277c382-8ccc-4a02-8946-959c4770aaa2 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e5b58b790>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:08.633333 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-e277c382-8ccc-4a02-8946-959c4770aaa2 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] HTTP exception thrown: Snapshot 0739352e-bf60-4c1c-8651-c2b57a16ef8a could not be found. May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e277c382-8ccc-4a02-8946-959c4770aaa2 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Request method failure captured: May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a HTTP/1.1 May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-cTwrADorzeGmjo0YrfggWfpMOHdvaG0Hi28_ZDlhVO-nZiAGBUZ2dHttz-zMPfO0wqCwpHLTttdgLMZ0l5CGHc9vH2ZM_EDxG4cD5UP-fK3TCo4YZ7QIeSUijETEglKTGC8SAPpgKo7A20AxuLRf1w_rkYt-hVjZkcJMqvNFSspWw May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: dda0e31bc2c8401180aeeb9133927878 May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:19:08.635558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: dda0e31bc2c8401180aeeb9133927878 May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-VolumesSnapshotsTestJSON-423199593-project May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: b29a396ea8fa45248ccca47b2f33a960 May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-VolumesSnapshotsTestJSON-423199593-project May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Snapshot 0739352e-bf60-4c1c-8651-c2b57a16ef8a could not be found. May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '0739352e-bf60-4c1c-8651-c2b57a16ef8a'} May 17 18:19:08.636961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0739352e-bf60-4c1c-8651-c2b57a16ef8a could not be found. (HTTP 404) (Request-ID: req-5228e43d-0d04-4884-8e52-5bb548d3705d) May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:08.638079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:19:08.639264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0739352e-bf60-4c1c-8651-c2b57a16ef8a could not be found. May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 17 18:19:08.640563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0739352e-bf60-4c1c-8651-c2b57a16ef8a could not be found. May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0739352e-bf60-4c1c-8651-c2b57a16ef8a could not be found. May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e277c382-8ccc-4a02-8946-959c4770aaa2 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Returning 404 to user: Snapshot 0739352e-bf60-4c1c-8651-c2b57a16ef8a could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e277c382-8ccc-4a02-8946-959c4770aaa2 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a" status: 404 len: 111 microversion: 2.1 time: 0.031074 May 17 18:19:08.641912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 183/305] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 17 18:19:08 2022] GET /compute/v2.1/os-snapshots/0739352e-bf60-4c1c-8651-c2b57a16ef8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:08.645230 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b5d79dca-8827-4fa8-8fb3-263baecd253a tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e605a9f70>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:08.702233 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b5d79dca-8827-4fa8-8fb3-263baecd253a tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b" status: 202 len: 0 microversion: 2.1 time: 0.060624 May 17 18:19:08.702801 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 123/306] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 17 18:19:08 2022] DELETE /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:19:08.711761 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-becf0f44-f348-49e6-9515-91a1f5111fb4 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e5b5e7dc0>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:08.758910 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-becf0f44-f348-49e6-9515-91a1f5111fb4 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b" status: 200 len: 345 microversion: 2.1 time: 0.051573 May 17 18:19:08.759803 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 184/307] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:19:08 2022] GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:08.907442 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e0b6c148-b437-4403-929a-a5e30f0766a3 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:08.908089 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e0b6c148-b437-4403-929a-a5e30f0766a3 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:08.914219 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0b6c148-b437-4403-929a-a5e30f0766a3 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:08.914702 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0b6c148-b437-4403-929a-a5e30f0766a3 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:08.915550 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0b6c148-b437-4403-929a-a5e30f0766a3 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:08.915993 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0b6c148-b437-4403-929a-a5e30f0766a3 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:09.043064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e0b6c148-b437-4403-929a-a5e30f0766a3 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:09.050288 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e0b6c148-b437-4403-929a-a5e30f0766a3 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.147313 May 17 18:19:09.050852 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 124/308] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:08 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:09.067968 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b72f0618-d338-46a1-87e7-4c7a203f14c0 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:09.068576 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b72f0618-d338-46a1-87e7-4c7a203f14c0 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:09.075345 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b72f0618-d338-46a1-87e7-4c7a203f14c0 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:09.075803 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b72f0618-d338-46a1-87e7-4c7a203f14c0 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:09.076553 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b72f0618-d338-46a1-87e7-4c7a203f14c0 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:09.076984 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b72f0618-d338-46a1-87e7-4c7a203f14c0 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:09.428832 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b72f0618-d338-46a1-87e7-4c7a203f14c0 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:09.436735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b72f0618-d338-46a1-87e7-4c7a203f14c0 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.372692 May 17 18:19:09.437294 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 185/309] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:09 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:09.450176 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-117420c7-5b9e-4a63-886d-ceaab578e541 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:09.450794 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-117420c7-5b9e-4a63-886d-ceaab578e541 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:09.456719 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-117420c7-5b9e-4a63-886d-ceaab578e541 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:09.457170 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-117420c7-5b9e-4a63-886d-ceaab578e541 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:09.457976 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-117420c7-5b9e-4a63-886d-ceaab578e541 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:09.458414 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-117420c7-5b9e-4a63-886d-ceaab578e541 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:09.587856 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-117420c7-5b9e-4a63-886d-ceaab578e541 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:09.595255 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-117420c7-5b9e-4a63-886d-ceaab578e541 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.149189 May 17 18:19:09.595822 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 125/310] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:09 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:09.771853 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9d3f325a-f1b5-4798-adfa-b720ef090958 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e5b776280>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:09.800055 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-9d3f325a-f1b5-4798-adfa-b720ef090958 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] HTTP exception thrown: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9d3f325a-f1b5-4798-adfa-b720ef090958 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Request method failure captured: May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b HTTP/1.1 May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-cTwrADorzeGmjo0YrfggWfpMOHdvaG0Hi28_ZDlhVO-nZiAGBUZ2dHttz-zMPfO0wqCwpHLTttdgLMZ0l5CGHc9vH2ZM_EDxG4cD5UP-fK3TCo4YZ7QIeSUijETEglKTGC8SAPpgKo7A20AxuLRf1w_rkYt-hVjZkcJMqvNFSspWw May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: dda0e31bc2c8401180aeeb9133927878 May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:19:09.802248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: dda0e31bc2c8401180aeeb9133927878 May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-VolumesSnapshotsTestJSON-423199593-project May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: b29a396ea8fa45248ccca47b2f33a960 May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-VolumesSnapshotsTestJSON-423199593-project May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '570cb021-b443-4cc9-865c-8ff05cff5b4b'} May 17 18:19:09.803731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. (HTTP 404) (Request-ID: req-a1c4b726-a199-4f56-8fa1-28fe85ccff43) May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:09.804536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:19:09.805559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 18:19:09.806544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9d3f325a-f1b5-4798-adfa-b720ef090958 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Returning 404 to user: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9d3f325a-f1b5-4798-adfa-b720ef090958 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b" status: 404 len: 109 microversion: 2.1 time: 0.035810 May 17 18:19:09.807540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 186/311] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:19:09 2022] GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:09.817484 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e401283d-064f-4548-b848-0b47afe32ad5 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e6053c940>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-e401283d-064f-4548-b848-0b47afe32ad5 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] HTTP exception thrown: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e401283d-064f-4548-b848-0b47afe32ad5 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Request method failure captured: May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: DELETE /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b HTTP/1.1 May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-cTwrADorzeGmjo0YrfggWfpMOHdvaG0Hi28_ZDlhVO-nZiAGBUZ2dHttz-zMPfO0wqCwpHLTttdgLMZ0l5CGHc9vH2ZM_EDxG4cD5UP-fK3TCo4YZ7QIeSUijETEglKTGC8SAPpgKo7A20AxuLRf1w_rkYt-hVjZkcJMqvNFSspWw May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: dda0e31bc2c8401180aeeb9133927878 May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:19:09.848281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: dda0e31bc2c8401180aeeb9133927878 May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-VolumesSnapshotsTestJSON-423199593-project May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: b29a396ea8fa45248ccca47b2f33a960 May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-VolumesSnapshotsTestJSON-423199593-project May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '570cb021-b443-4cc9-865c-8ff05cff5b4b'} May 17 18:19:09.853164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. (HTTP 404) (Request-ID: req-65bfe5c8-2648-4fdc-9c13-5f4cf863bca5) May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:09.854110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 17 18:19:09.855138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 17 18:19:09.856155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e401283d-064f-4548-b848-0b47afe32ad5 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Returning 404 to user: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e401283d-064f-4548-b848-0b47afe32ad5 tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b" status: 404 len: 109 microversion: 2.1 time: 0.034706 May 17 18:19:09.857286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 126/312] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 17 18:19:09 2022] DELETE /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:09.858102 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aab54ca2-5918-4b64-8200-9981accc3adf tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Calling method '.version_select at 0x7f4e5b58bf70>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:09.887551 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-aab54ca2-5918-4b64-8200-9981accc3adf tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] HTTP exception thrown: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aab54ca2-5918-4b64-8200-9981accc3adf tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Request method failure captured: May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b HTTP/1.1 May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-cTwrADorzeGmjo0YrfggWfpMOHdvaG0Hi28_ZDlhVO-nZiAGBUZ2dHttz-zMPfO0wqCwpHLTttdgLMZ0l5CGHc9vH2ZM_EDxG4cD5UP-fK3TCo4YZ7QIeSUijETEglKTGC8SAPpgKo7A20AxuLRf1w_rkYt-hVjZkcJMqvNFSspWw May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: dda0e31bc2c8401180aeeb9133927878 May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:19:09.889546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/dda0e31bc2c8401180aeeb9133927878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: dda0e31bc2c8401180aeeb9133927878 May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-423199593 May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-VolumesSnapshotsTestJSON-423199593-project May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: b29a396ea8fa45248ccca47b2f33a960 May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-VolumesSnapshotsTestJSON-423199593-project May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '570cb021-b443-4cc9-865c-8ff05cff5b4b'} May 17 18:19:09.890957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. (HTTP 404) (Request-ID: req-ef8e7985-62d6-4a9e-92f7-4667861b56b5) May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:09.893205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:19:09.894549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 18:19:09.895563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aab54ca2-5918-4b64-8200-9981accc3adf tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] Returning 404 to user: Volume 570cb021-b443-4cc9-865c-8ff05cff5b4b could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-aab54ca2-5918-4b64-8200-9981accc3adf tempest-VolumesSnapshotsTestJSON-423199593 tempest-VolumesSnapshotsTestJSON-423199593-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b" status: 404 len: 109 microversion: 2.1 time: 0.037319 May 17 18:19:09.897015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 187/313] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:19:09 2022] GET /compute/v2.1/os-volumes/570cb021-b443-4cc9-865c-8ff05cff5b4b => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:10.067644 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6997f0ea-edca-4405-a61a-0a70dc28e365 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:10.068238 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6997f0ea-edca-4405-a61a-0a70dc28e365 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:10.077610 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6997f0ea-edca-4405-a61a-0a70dc28e365 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:10.078064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6997f0ea-edca-4405-a61a-0a70dc28e365 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:10.078851 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6997f0ea-edca-4405-a61a-0a70dc28e365 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:10.079292 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6997f0ea-edca-4405-a61a-0a70dc28e365 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:10.227466 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6997f0ea-edca-4405-a61a-0a70dc28e365 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:10.235674 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6997f0ea-edca-4405-a61a-0a70dc28e365 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.172920 May 17 18:19:10.236510 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 127/314] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:10 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:10.454209 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8d4f0e43-2863-4877-a171-766bf41ca77b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:10.454835 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-8d4f0e43-2863-4877-a171-766bf41ca77b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:10.461020 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8d4f0e43-2863-4877-a171-766bf41ca77b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:10.461491 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8d4f0e43-2863-4877-a171-766bf41ca77b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:10.462530 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8d4f0e43-2863-4877-a171-766bf41ca77b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:10.463127 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8d4f0e43-2863-4877-a171-766bf41ca77b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:10.612784 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1e79c329-0815-4298-a388-d44a83da6fda tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:10.613447 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1e79c329-0815-4298-a388-d44a83da6fda tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:10.620947 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e79c329-0815-4298-a388-d44a83da6fda tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:10.621416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e79c329-0815-4298-a388-d44a83da6fda tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:10.622337 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e79c329-0815-4298-a388-d44a83da6fda tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:10.623284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e79c329-0815-4298-a388-d44a83da6fda tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:10.644597 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8d4f0e43-2863-4877-a171-766bf41ca77b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:10.656926 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8d4f0e43-2863-4877-a171-766bf41ca77b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.206520 May 17 18:19:10.658295 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 188/315] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:10 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:10.783469 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1e79c329-0815-4298-a388-d44a83da6fda tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:10.797037 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1e79c329-0815-4298-a388-d44a83da6fda tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.188302 May 17 18:19:10.809061 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 128/316] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:10 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:11.253423 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7fb0df0a-2382-4b68-849a-64e6a170b2cf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:11.254076 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7fb0df0a-2382-4b68-849a-64e6a170b2cf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:11.259927 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7fb0df0a-2382-4b68-849a-64e6a170b2cf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:11.260377 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7fb0df0a-2382-4b68-849a-64e6a170b2cf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:11.261142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7fb0df0a-2382-4b68-849a-64e6a170b2cf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:11.261609 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7fb0df0a-2382-4b68-849a-64e6a170b2cf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:11.396392 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7fb0df0a-2382-4b68-849a-64e6a170b2cf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:11.404308 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7fb0df0a-2382-4b68-849a-64e6a170b2cf tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.154677 May 17 18:19:11.404872 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 189/317] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:11 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:11.675487 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-97274c18-f7b6-4462-ad81-f0005d02943a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:11.676093 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-97274c18-f7b6-4462-ad81-f0005d02943a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:11.682868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97274c18-f7b6-4462-ad81-f0005d02943a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:11.683317 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97274c18-f7b6-4462-ad81-f0005d02943a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:11.684075 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97274c18-f7b6-4462-ad81-f0005d02943a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:11.684527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97274c18-f7b6-4462-ad81-f0005d02943a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:11.814674 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f4e77c18-21d4-4220-87d7-63fb2008ac12 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:11.815321 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f4e77c18-21d4-4220-87d7-63fb2008ac12 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:11.817436 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-97274c18-f7b6-4462-ad81-f0005d02943a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:11.821823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f4e77c18-21d4-4220-87d7-63fb2008ac12 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:11.822280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f4e77c18-21d4-4220-87d7-63fb2008ac12 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:11.823052 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f4e77c18-21d4-4220-87d7-63fb2008ac12 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:11.823747 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f4e77c18-21d4-4220-87d7-63fb2008ac12 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:11.825839 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-97274c18-f7b6-4462-ad81-f0005d02943a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.154186 May 17 18:19:11.826430 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 129/318] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:11 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:11.967388 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f4e77c18-21d4-4220-87d7-63fb2008ac12 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:11.975727 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f4e77c18-21d4-4220-87d7-63fb2008ac12 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.165221 May 17 18:19:11.977271 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 190/319] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:11 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:12.421045 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-52c1a663-b194-4220-a172-fc9c5d078e4f tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:12.421773 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-52c1a663-b194-4220-a172-fc9c5d078e4f tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:12.427718 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-52c1a663-b194-4220-a172-fc9c5d078e4f tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:12.428242 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-52c1a663-b194-4220-a172-fc9c5d078e4f tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:12.429203 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-52c1a663-b194-4220-a172-fc9c5d078e4f tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:12.429764 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-52c1a663-b194-4220-a172-fc9c5d078e4f tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:12.633853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-52c1a663-b194-4220-a172-fc9c5d078e4f tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:12.641907 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-52c1a663-b194-4220-a172-fc9c5d078e4f tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1314 microversion: 2.1 time: 0.224443 May 17 18:19:12.642211 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 130/320] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:12 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:12.845654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c83c3755-65e8-4fe2-abb8-30e8724053c1 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:12.846807 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c83c3755-65e8-4fe2-abb8-30e8724053c1 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:12.855764 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c83c3755-65e8-4fe2-abb8-30e8724053c1 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:12.856512 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c83c3755-65e8-4fe2-abb8-30e8724053c1 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:12.857289 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c83c3755-65e8-4fe2-abb8-30e8724053c1 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:12.857981 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c83c3755-65e8-4fe2-abb8-30e8724053c1 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:12.942727 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-1f1bf98a-9af1-4f26-b9ac-5a483857c5a1 req-35fbc223-6685-4457-84c6-18b33574dc8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec13a585-cf06-497f-8381-d90b5531f029", "name": "network-vif-plugged", "status": "completed", "tag": "46b16982-1e63-43c1-a0be-4dfa4d935943"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:12.957125 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-1f1bf98a-9af1-4f26-b9ac-5a483857c5a1 req-35fbc223-6685-4457-84c6-18b33574dc8d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:12.958012 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-1f1bf98a-9af1-4f26-b9ac-5a483857c5a1 req-35fbc223-6685-4457-84c6-18b33574dc8d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:12.972283 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-1f1bf98a-9af1-4f26-b9ac-5a483857c5a1 req-35fbc223-6685-4457-84c6-18b33574dc8d service nova] Creating event network-vif-plugged:46b16982-1e63-43c1-a0be-4dfa4d935943 for instance ec13a585-cf06-497f-8381-d90b5531f029 on hv-cinder-83736 May 17 18:19:12.978639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-1f1bf98a-9af1-4f26-b9ac-5a483857c5a1 req-35fbc223-6685-4457-84c6-18b33574dc8d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040461 May 17 18:19:12.979817 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 131/321] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:12.995131 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a910264e-bcfd-423a-85ae-f3c4e9fc109f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:12.996001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a910264e-bcfd-423a-85ae-f3c4e9fc109f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:13.002854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c83c3755-65e8-4fe2-abb8-30e8724053c1 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:13.004718 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a910264e-bcfd-423a-85ae-f3c4e9fc109f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:13.005667 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a910264e-bcfd-423a-85ae-f3c4e9fc109f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:13.006669 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a910264e-bcfd-423a-85ae-f3c4e9fc109f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:13.007373 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a910264e-bcfd-423a-85ae-f3c4e9fc109f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:13.012166 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c83c3755-65e8-4fe2-abb8-30e8724053c1 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.170856 May 17 18:19:13.013506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 191/322] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:12 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:13.175354 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a910264e-bcfd-423a-85ae-f3c4e9fc109f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:13.184330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a910264e-bcfd-423a-85ae-f3c4e9fc109f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.194336 May 17 18:19:13.185691 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 132/323] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:12 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:13.658700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-35164771-3bc9-45d7-8e5e-f0390e4bf8c1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:13.659281 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-35164771-3bc9-45d7-8e5e-f0390e4bf8c1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:13.665233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-35164771-3bc9-45d7-8e5e-f0390e4bf8c1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:13.665702 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-35164771-3bc9-45d7-8e5e-f0390e4bf8c1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:13.666769 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-35164771-3bc9-45d7-8e5e-f0390e4bf8c1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:13.667219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-35164771-3bc9-45d7-8e5e-f0390e4bf8c1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:13.806493 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-35164771-3bc9-45d7-8e5e-f0390e4bf8c1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:13.813812 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-35164771-3bc9-45d7-8e5e-f0390e4bf8c1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1464 microversion: 2.1 time: 0.159330 May 17 18:19:13.814377 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 192/324] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:13 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:13.854038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7ec1e5de-1c12-489c-9719-a07d408ca7b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:13.854537 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7ec1e5de-1c12-489c-9719-a07d408ca7b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:13.860534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ec1e5de-1c12-489c-9719-a07d408ca7b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:13.860977 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ec1e5de-1c12-489c-9719-a07d408ca7b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:13.861780 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ec1e5de-1c12-489c-9719-a07d408ca7b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:13.862220 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ec1e5de-1c12-489c-9719-a07d408ca7b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:13.887985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7ec1e5de-1c12-489c-9719-a07d408ca7b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:19:13.977723 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7ec1e5de-1c12-489c-9719-a07d408ca7b1 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "DELETE /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 204 len: 0 microversion: 2.1 time: 0.127111 May 17 18:19:13.982359 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 133/325] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:19:13 2022] DELETE /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:19:13.987149 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-46b3dfa0-98dc-46a8-9c73-dc227fe745ec tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:13.987768 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-46b3dfa0-98dc-46a8-9c73-dc227fe745ec tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:13.994634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-46b3dfa0-98dc-46a8-9c73-dc227fe745ec tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:13.995138 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-46b3dfa0-98dc-46a8-9c73-dc227fe745ec tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:13.995914 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-46b3dfa0-98dc-46a8-9c73-dc227fe745ec tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:13.996380 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-46b3dfa0-98dc-46a8-9c73-dc227fe745ec tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:14.029858 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5fde83f0-dfa8-4aae-8ece-ecf66feba4a8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:14.030697 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5fde83f0-dfa8-4aae-8ece-ecf66feba4a8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:14.041728 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5fde83f0-dfa8-4aae-8ece-ecf66feba4a8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:14.042185 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5fde83f0-dfa8-4aae-8ece-ecf66feba4a8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:14.047641 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5fde83f0-dfa8-4aae-8ece-ecf66feba4a8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:14.048205 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5fde83f0-dfa8-4aae-8ece-ecf66feba4a8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:14.188608 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-46b3dfa0-98dc-46a8-9c73-dc227fe745ec tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:14.196796 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-46b3dfa0-98dc-46a8-9c73-dc227fe745ec tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1470 microversion: 2.1 time: 0.213517 May 17 18:19:14.197909 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 193/326] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:13 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1470 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:14.203210 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-49335f0d-11cb-45a8-9be8-f0575db2302d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:14.204065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-49335f0d-11cb-45a8-9be8-f0575db2302d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:14.210674 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-49335f0d-11cb-45a8-9be8-f0575db2302d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:14.211127 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-49335f0d-11cb-45a8-9be8-f0575db2302d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:14.211903 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-49335f0d-11cb-45a8-9be8-f0575db2302d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:14.212350 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-49335f0d-11cb-45a8-9be8-f0575db2302d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:14.225858 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5fde83f0-dfa8-4aae-8ece-ecf66feba4a8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:14.233649 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5fde83f0-dfa8-4aae-8ece-ecf66feba4a8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.207945 May 17 18:19:14.234221 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 134/327] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:14 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:14.347197 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-49335f0d-11cb-45a8-9be8-f0575db2302d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:14.354548 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-49335f0d-11cb-45a8-9be8-f0575db2302d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.155303 May 17 18:19:14.355112 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 194/328] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:14 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:15.214422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b4607701-aee5-4b67-a10f-2b052d7dad5c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:15.215676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b4607701-aee5-4b67-a10f-2b052d7dad5c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:15.222127 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b4607701-aee5-4b67-a10f-2b052d7dad5c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:15.222590 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b4607701-aee5-4b67-a10f-2b052d7dad5c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:15.223401 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b4607701-aee5-4b67-a10f-2b052d7dad5c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:15.223848 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b4607701-aee5-4b67-a10f-2b052d7dad5c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:15.253371 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-803d04fd-dc99-4c3c-a6c6-ef01fb896d4e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:15.253371 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-803d04fd-dc99-4c3c-a6c6-ef01fb896d4e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:15.263822 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-803d04fd-dc99-4c3c-a6c6-ef01fb896d4e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:15.264385 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-803d04fd-dc99-4c3c-a6c6-ef01fb896d4e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:15.265243 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-803d04fd-dc99-4c3c-a6c6-ef01fb896d4e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:15.265712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-803d04fd-dc99-4c3c-a6c6-ef01fb896d4e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:15.399698 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b4607701-aee5-4b67-a10f-2b052d7dad5c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:15.407807 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b4607701-aee5-4b67-a10f-2b052d7dad5c tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1470 microversion: 2.1 time: 0.197122 May 17 18:19:15.408503 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 135/329] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:15 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1470 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:15.414001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-bb722fc7-b40d-4034-ad88-6534a2991a5c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:15.415379 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-bb722fc7-b40d-4034-ad88-6534a2991a5c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:15.422304 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bb722fc7-b40d-4034-ad88-6534a2991a5c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:15.422952 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bb722fc7-b40d-4034-ad88-6534a2991a5c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:15.423890 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bb722fc7-b40d-4034-ad88-6534a2991a5c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:15.424498 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bb722fc7-b40d-4034-ad88-6534a2991a5c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:15.452953 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-803d04fd-dc99-4c3c-a6c6-ef01fb896d4e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:15.461885 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-803d04fd-dc99-4c3c-a6c6-ef01fb896d4e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.213494 May 17 18:19:15.462758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 195/330] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:15 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:15.563286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bb722fc7-b40d-4034-ad88-6534a2991a5c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:15.576653 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-bb722fc7-b40d-4034-ad88-6534a2991a5c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.166553 May 17 18:19:15.577267 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 136/331] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:15 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:16.432531 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-075a5512-a06a-48b8-9047-9647aa73b530 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:16.433179 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-075a5512-a06a-48b8-9047-9647aa73b530 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:16.439181 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-075a5512-a06a-48b8-9047-9647aa73b530 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:16.439642 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-075a5512-a06a-48b8-9047-9647aa73b530 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:16.440409 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-075a5512-a06a-48b8-9047-9647aa73b530 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:16.440842 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-075a5512-a06a-48b8-9047-9647aa73b530 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:16.478946 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-79915bba-61ce-4c08-bb39-8c2a9cd57198 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:16.479718 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-79915bba-61ce-4c08-bb39-8c2a9cd57198 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:16.486935 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-79915bba-61ce-4c08-bb39-8c2a9cd57198 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:16.487897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-79915bba-61ce-4c08-bb39-8c2a9cd57198 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:16.489154 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-79915bba-61ce-4c08-bb39-8c2a9cd57198 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:16.489843 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-79915bba-61ce-4c08-bb39-8c2a9cd57198 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:16.631138 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-075a5512-a06a-48b8-9047-9647aa73b530 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:16.641339 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-075a5512-a06a-48b8-9047-9647aa73b530 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1470 microversion: 2.1 time: 0.213138 May 17 18:19:16.647826 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 196/332] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:16 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1470 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:16.656101 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-200ff89d-446f-4ea7-975a-ad3f583ba6c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:16.658874 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-200ff89d-446f-4ea7-975a-ad3f583ba6c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:16.662153 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-79915bba-61ce-4c08-bb39-8c2a9cd57198 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:16.674469 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-79915bba-61ce-4c08-bb39-8c2a9cd57198 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1318 microversion: 2.1 time: 0.199616 May 17 18:19:16.675026 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-200ff89d-446f-4ea7-975a-ad3f583ba6c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:16.675506 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 137/333] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:16 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:16.685242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-200ff89d-446f-4ea7-975a-ad3f583ba6c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:16.685242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-200ff89d-446f-4ea7-975a-ad3f583ba6c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:16.685242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-200ff89d-446f-4ea7-975a-ad3f583ba6c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:16.831137 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-200ff89d-446f-4ea7-975a-ad3f583ba6c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:16.839699 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-200ff89d-446f-4ea7-975a-ad3f583ba6c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.190632 May 17 18:19:16.840468 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 197/334] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:16 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:16.990509 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-464330ea-bd85-4ba4-84f2-858df5827feb req-fbc1f7bf-4e4f-48cb-b85a-85d873db2a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bdccfdf-2183-49d1-8ab7-6d7e06fffad6", "name": "network-vif-deleted", "tag": "7984d267-97c2-46c7-b026-dd53166455a6"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:16.999448 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-464330ea-bd85-4ba4-84f2-858df5827feb req-fbc1f7bf-4e4f-48cb-b85a-85d873db2a47 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:16.999991 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-464330ea-bd85-4ba4-84f2-858df5827feb req-fbc1f7bf-4e4f-48cb-b85a-85d873db2a47 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:17.013196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-464330ea-bd85-4ba4-84f2-858df5827feb req-fbc1f7bf-4e4f-48cb-b85a-85d873db2a47 service nova] Creating event network-vif-deleted:7984d267-97c2-46c7-b026-dd53166455a6 for instance 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 on hv-cinder-83736 May 17 18:19:17.019064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-464330ea-bd85-4ba4-84f2-858df5827feb req-fbc1f7bf-4e4f-48cb-b85a-85d873db2a47 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032628 May 17 18:19:17.019888 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 138/335] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:17.663657 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-25f1c3f5-03a1-400f-b8ed-2bd1582f65ce tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:17.664263 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-25f1c3f5-03a1-400f-b8ed-2bd1582f65ce tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:17.670913 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25f1c3f5-03a1-400f-b8ed-2bd1582f65ce tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:17.671372 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25f1c3f5-03a1-400f-b8ed-2bd1582f65ce tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:17.672155 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25f1c3f5-03a1-400f-b8ed-2bd1582f65ce tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:17.672595 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25f1c3f5-03a1-400f-b8ed-2bd1582f65ce tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:17.693157 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-90ed1660-3d3d-42d1-9601-858ac6b057d8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:17.693925 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-90ed1660-3d3d-42d1-9601-858ac6b057d8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:17.701955 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-90ed1660-3d3d-42d1-9601-858ac6b057d8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:17.702646 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-90ed1660-3d3d-42d1-9601-858ac6b057d8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:17.703437 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-90ed1660-3d3d-42d1-9601-858ac6b057d8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:17.703905 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-90ed1660-3d3d-42d1-9601-858ac6b057d8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:17.716220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25f1c3f5-03a1-400f-b8ed-2bd1582f65ce tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:17.716720 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25f1c3f5-03a1-400f-b8ed-2bd1582f65ce tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:17.717181 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-25f1c3f5-03a1-400f-b8ed-2bd1582f65ce tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lazy-loading 'fault' on Instance uuid 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:19:17.771272 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-25f1c3f5-03a1-400f-b8ed-2bd1582f65ce tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c725fea1d5574c8382d3d8fb9fd61526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f60fdd09f5b450bb6cb18902bf860e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:17.781358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-25f1c3f5-03a1-400f-b8ed-2bd1582f65ce tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 200 len: 1304 microversion: 2.1 time: 0.121448 May 17 18:19:17.781990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 198/336] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:17 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:17.856645 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fd1b672a-edba-424c-bf44-9a2a5f3404da tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:17.857265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fd1b672a-edba-424c-bf44-9a2a5f3404da tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:17.865180 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd1b672a-edba-424c-bf44-9a2a5f3404da tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:17.865776 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd1b672a-edba-424c-bf44-9a2a5f3404da tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:17.867408 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd1b672a-edba-424c-bf44-9a2a5f3404da tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:17.868156 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd1b672a-edba-424c-bf44-9a2a5f3404da tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:17.897206 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-90ed1660-3d3d-42d1-9601-858ac6b057d8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:17.908322 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-90ed1660-3d3d-42d1-9601-858ac6b057d8 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1508 microversion: 2.1 time: 0.219693 May 17 18:19:17.909151 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 139/337] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:17 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1508 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:18.063220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fd1b672a-edba-424c-bf44-9a2a5f3404da tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:18.077975 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fd1b672a-edba-424c-bf44-9a2a5f3404da tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.225465 May 17 18:19:18.078762 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 199/338] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:17 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:18.798720 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7fc61e0e-9c55-478e-825d-8a1d03dba0b7 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:18.799324 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7fc61e0e-9c55-478e-825d-8a1d03dba0b7 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] [instance: 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:18.805941 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fc61e0e-9c55-478e-825d-8a1d03dba0b7 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:18.806394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fc61e0e-9c55-478e-825d-8a1d03dba0b7 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:18.807175 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fc61e0e-9c55-478e-825d-8a1d03dba0b7 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:18.807614 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fc61e0e-9c55-478e-825d-8a1d03dba0b7 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:18.822212 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-7fc61e0e-9c55-478e-825d-8a1d03dba0b7 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] HTTP exception thrown: Instance 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 could not be found. May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7fc61e0e-9c55-478e-825d-8a1d03dba0b7 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Request method failure captured: May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 HTTP/1.1 May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-cHMt2wSQch1xccMplNaA43gLwbQES2tV-P6CQqHRtwVTxcipNiwj7bLWEZXONi1F5RiB8nCkXkKpy4txiODSKxrthbAaWTVWUPWsYKV0r8kWIEEFgUWMleEmvMaN6jpBIJhFjMu7JGhUO4qreupti796byPBR9NQChEpSri6_kGfs May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 4f60fdd09f5b450bb6cb18902bf860e0 May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-VolumesNegativeTest-858400590 May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:19:18.824258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_4f60fdd09f5b450bb6cb18902bf860e0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f60fdd09f5b450bb6cb18902bf860e0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/4f60fdd09f5b450bb6cb18902bf860e0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/4f60fdd09f5b450bb6cb18902bf860e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-VolumesNegativeTest-858400590 May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 4f60fdd09f5b450bb6cb18902bf860e0 May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-VolumesNegativeTest-858400590 May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-VolumesNegativeTest-858400590-project May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: c725fea1d5574c8382d3d8fb9fd61526 May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-VolumesNegativeTest-858400590-project May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 could not be found. May 17 18:19:18.825380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '2bdccfdf-2183-49d1-8ab7-6d7e06fffad6'} May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 could not be found. May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:18.826116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 could not be found. May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 could not be found. May 17 18:19:18.827196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:19:18.828245 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7fc61e0e-9c55-478e-825d-8a1d03dba0b7 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] Returning 404 to user: Instance 2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:18.828245 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7fc61e0e-9c55-478e-825d-8a1d03dba0b7 tempest-VolumesNegativeTest-858400590 tempest-VolumesNegativeTest-858400590-project] 10.222.0.65 "GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6" status: 404 len: 111 microversion: 2.1 time: 0.030910 May 17 18:19:18.828245 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 140/339] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:18 2022] GET /compute/v2.1/servers/2bdccfdf-2183-49d1-8ab7-6d7e06fffad6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:19:19.095229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d732a0f9-a752-4904-b982-4b2decd889fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:19.095934 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d732a0f9-a752-4904-b982-4b2decd889fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:19.102973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d732a0f9-a752-4904-b982-4b2decd889fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:19.103741 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d732a0f9-a752-4904-b982-4b2decd889fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:19.104791 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d732a0f9-a752-4904-b982-4b2decd889fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:19.105595 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d732a0f9-a752-4904-b982-4b2decd889fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:19.378016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d732a0f9-a752-4904-b982-4b2decd889fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:19.388552 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d732a0f9-a752-4904-b982-4b2decd889fd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.297655 May 17 18:19:19.389694 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 200/340] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:19 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:20.407070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a6686fcb-18e0-4850-901d-b6d74e92809c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:20.407791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a6686fcb-18e0-4850-901d-b6d74e92809c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:20.415252 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6686fcb-18e0-4850-901d-b6d74e92809c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:20.416057 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6686fcb-18e0-4850-901d-b6d74e92809c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:20.417052 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6686fcb-18e0-4850-901d-b6d74e92809c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:20.417724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6686fcb-18e0-4850-901d-b6d74e92809c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:20.603160 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a6686fcb-18e0-4850-901d-b6d74e92809c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:20.610900 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a6686fcb-18e0-4850-901d-b6d74e92809c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.208112 May 17 18:19:20.611569 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 141/341] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:20 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:21.627645 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-91be8b62-4c95-4a4c-95b2-267bdd40551f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:21.628255 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-91be8b62-4c95-4a4c-95b2-267bdd40551f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:21.639428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-91be8b62-4c95-4a4c-95b2-267bdd40551f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:21.640442 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-91be8b62-4c95-4a4c-95b2-267bdd40551f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:21.641290 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-91be8b62-4c95-4a4c-95b2-267bdd40551f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:21.641766 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-91be8b62-4c95-4a4c-95b2-267bdd40551f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:21.800056 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-91be8b62-4c95-4a4c-95b2-267bdd40551f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:21.807825 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-91be8b62-4c95-4a4c-95b2-267bdd40551f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.184009 May 17 18:19:21.808396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 201/342] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:21 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:22.825081 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7adf36ac-cf3b-4466-96d4-f5c5ad18475f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:22.825720 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7adf36ac-cf3b-4466-96d4-f5c5ad18475f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:22.831871 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7adf36ac-cf3b-4466-96d4-f5c5ad18475f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:22.832334 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7adf36ac-cf3b-4466-96d4-f5c5ad18475f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:22.833111 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7adf36ac-cf3b-4466-96d4-f5c5ad18475f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:22.833591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7adf36ac-cf3b-4466-96d4-f5c5ad18475f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:22.980407 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7adf36ac-cf3b-4466-96d4-f5c5ad18475f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:22.988791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7adf36ac-cf3b-4466-96d4-f5c5ad18475f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.167751 May 17 18:19:22.989639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 142/343] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:22 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:24.007543 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ea6359b8-edd9-45ae-bea8-2c87296f127e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:24.008159 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ea6359b8-edd9-45ae-bea8-2c87296f127e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:24.014003 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ea6359b8-edd9-45ae-bea8-2c87296f127e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:24.014454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ea6359b8-edd9-45ae-bea8-2c87296f127e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:24.015257 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ea6359b8-edd9-45ae-bea8-2c87296f127e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:24.015696 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ea6359b8-edd9-45ae-bea8-2c87296f127e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:24.161606 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ea6359b8-edd9-45ae-bea8-2c87296f127e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:24.172705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ea6359b8-edd9-45ae-bea8-2c87296f127e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.169970 May 17 18:19:24.173284 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 202/344] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:24 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:25.189656 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-fb9bb8c0-4a90-4778-9458-1483db124418 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:25.190406 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-fb9bb8c0-4a90-4778-9458-1483db124418 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:25.198026 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fb9bb8c0-4a90-4778-9458-1483db124418 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:25.198824 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fb9bb8c0-4a90-4778-9458-1483db124418 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:25.199607 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fb9bb8c0-4a90-4778-9458-1483db124418 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:25.200053 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fb9bb8c0-4a90-4778-9458-1483db124418 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:25.341841 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-fb9bb8c0-4a90-4778-9458-1483db124418 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:25.349040 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-fb9bb8c0-4a90-4778-9458-1483db124418 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1519 microversion: 2.1 time: 0.163319 May 17 18:19:25.349632 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 143/345] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:25 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:26.366572 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-88632de8-574a-409b-95d5-a6e49eb04b3e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:26.367163 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-88632de8-574a-409b-95d5-a6e49eb04b3e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:26.373266 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-88632de8-574a-409b-95d5-a6e49eb04b3e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:26.373698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-88632de8-574a-409b-95d5-a6e49eb04b3e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:26.374689 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-88632de8-574a-409b-95d5-a6e49eb04b3e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:26.375138 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-88632de8-574a-409b-95d5-a6e49eb04b3e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:26.501134 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-88632de8-574a-409b-95d5-a6e49eb04b3e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:26.508509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-88632de8-574a-409b-95d5-a6e49eb04b3e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1499 microversion: 2.1 time: 0.146655 May 17 18:19:26.509076 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 203/346] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:26 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1499 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:26.524211 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f67b3ebe-3abb-4f01-b0da-5d805c25c611 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:26.524830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f67b3ebe-3abb-4f01-b0da-5d805c25c611 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:26.531065 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f67b3ebe-3abb-4f01-b0da-5d805c25c611 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:26.531524 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f67b3ebe-3abb-4f01-b0da-5d805c25c611 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:26.532297 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f67b3ebe-3abb-4f01-b0da-5d805c25c611 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:26.532739 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f67b3ebe-3abb-4f01-b0da-5d805c25c611 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:26.666630 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f67b3ebe-3abb-4f01-b0da-5d805c25c611 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:26.673770 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f67b3ebe-3abb-4f01-b0da-5d805c25c611 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1514 microversion: 2.1 time: 0.153316 May 17 18:19:26.674327 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 144/347] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:26 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:29.071994 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-33ff43d0-2661-4f69-91ef-7361af3cd634 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:29.073011 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-33ff43d0-2661-4f69-91ef-7361af3cd634 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:29.079116 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-33ff43d0-2661-4f69-91ef-7361af3cd634 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:29.079563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-33ff43d0-2661-4f69-91ef-7361af3cd634 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:29.080321 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-33ff43d0-2661-4f69-91ef-7361af3cd634 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:29.080757 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-33ff43d0-2661-4f69-91ef-7361af3cd634 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:29.103080 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-33ff43d0-2661-4f69-91ef-7361af3cd634 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lazy-loading 'flavor' on Instance uuid 01e82dfe-21e6-427a-82b1-0b2362423057 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:19:29.212068 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-33ff43d0-2661-4f69-91ef-7361af3cd634 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "POST /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057/action" status: 200 len: 32 microversion: 2.1 time: 0.144552 May 17 18:19:29.216945 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 204/348] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:19:29 2022] POST /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057/action => generated 32 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:19:29.223113 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-91ec434f-f0e7-4ed8-a6cc-f9fe14d736d7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:29.224282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-91ec434f-f0e7-4ed8-a6cc-f9fe14d736d7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:29.231850 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-91ec434f-f0e7-4ed8-a6cc-f9fe14d736d7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:29.232382 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-91ec434f-f0e7-4ed8-a6cc-f9fe14d736d7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:29.233980 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-91ec434f-f0e7-4ed8-a6cc-f9fe14d736d7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:29.234499 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-91ec434f-f0e7-4ed8-a6cc-f9fe14d736d7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:29.363507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-91ec434f-f0e7-4ed8-a6cc-f9fe14d736d7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:29.371724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-91ec434f-f0e7-4ed8-a6cc-f9fe14d736d7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.152844 May 17 18:19:29.372289 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 145/349] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:29 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:30.389208 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-13f71f98-17f3-46b2-bfff-87524e9ce301 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:30.389979 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-13f71f98-17f3-46b2-bfff-87524e9ce301 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:30.396212 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-13f71f98-17f3-46b2-bfff-87524e9ce301 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:30.396698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-13f71f98-17f3-46b2-bfff-87524e9ce301 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:30.397486 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-13f71f98-17f3-46b2-bfff-87524e9ce301 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:30.397943 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-13f71f98-17f3-46b2-bfff-87524e9ce301 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:30.535000 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-13f71f98-17f3-46b2-bfff-87524e9ce301 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:30.544516 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-13f71f98-17f3-46b2-bfff-87524e9ce301 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.159479 May 17 18:19:30.545405 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 205/350] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:30 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:31.561502 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-42b27309-1704-4591-a772-74b2b261b802 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:31.562058 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-42b27309-1704-4591-a772-74b2b261b802 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:31.568577 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-42b27309-1704-4591-a772-74b2b261b802 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:31.569046 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-42b27309-1704-4591-a772-74b2b261b802 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:31.569855 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-42b27309-1704-4591-a772-74b2b261b802 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:31.570923 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-42b27309-1704-4591-a772-74b2b261b802 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:31.699964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-42b27309-1704-4591-a772-74b2b261b802 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:31.707347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-42b27309-1704-4591-a772-74b2b261b802 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.149730 May 17 18:19:31.707919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 146/351] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:31 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:32.724178 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c20321b4-654a-4c9e-b73d-88e46bca49ae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:32.724793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c20321b4-654a-4c9e-b73d-88e46bca49ae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:32.731009 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c20321b4-654a-4c9e-b73d-88e46bca49ae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:32.731469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c20321b4-654a-4c9e-b73d-88e46bca49ae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:32.732261 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c20321b4-654a-4c9e-b73d-88e46bca49ae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:32.732698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c20321b4-654a-4c9e-b73d-88e46bca49ae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:32.864603 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c20321b4-654a-4c9e-b73d-88e46bca49ae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:32.872391 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c20321b4-654a-4c9e-b73d-88e46bca49ae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.152124 May 17 18:19:32.872950 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 206/352] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:32 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:33.889263 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c4198626-c156-4a6f-b111-8b0bcdd27651 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:33.889935 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c4198626-c156-4a6f-b111-8b0bcdd27651 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:33.896144 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4198626-c156-4a6f-b111-8b0bcdd27651 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:33.896650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4198626-c156-4a6f-b111-8b0bcdd27651 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:33.897368 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4198626-c156-4a6f-b111-8b0bcdd27651 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:33.897831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4198626-c156-4a6f-b111-8b0bcdd27651 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:34.031942 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c4198626-c156-4a6f-b111-8b0bcdd27651 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:34.039587 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c4198626-c156-4a6f-b111-8b0bcdd27651 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.154120 May 17 18:19:34.040323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 147/353] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:33 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:35.056284 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7ef7cc04-d7b6-46f9-ae55-7d57ddbcb8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:35.056928 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7ef7cc04-d7b6-46f9-ae55-7d57ddbcb8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:35.062830 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7ef7cc04-d7b6-46f9-ae55-7d57ddbcb8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:35.063281 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7ef7cc04-d7b6-46f9-ae55-7d57ddbcb8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:35.064047 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7ef7cc04-d7b6-46f9-ae55-7d57ddbcb8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:35.064487 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7ef7cc04-d7b6-46f9-ae55-7d57ddbcb8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:35.187063 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7ef7cc04-d7b6-46f9-ae55-7d57ddbcb8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:35.194375 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7ef7cc04-d7b6-46f9-ae55-7d57ddbcb8b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.142459 May 17 18:19:35.195724 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 207/354] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:35 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:36.211790 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6e2355a5-b381-41e1-9df7-77d67dd8ae1f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:36.212414 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6e2355a5-b381-41e1-9df7-77d67dd8ae1f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:36.218994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e2355a5-b381-41e1-9df7-77d67dd8ae1f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:36.219453 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e2355a5-b381-41e1-9df7-77d67dd8ae1f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:36.220229 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e2355a5-b381-41e1-9df7-77d67dd8ae1f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:36.220677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e2355a5-b381-41e1-9df7-77d67dd8ae1f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:36.348914 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6e2355a5-b381-41e1-9df7-77d67dd8ae1f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:36.357053 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6e2355a5-b381-41e1-9df7-77d67dd8ae1f tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.149122 May 17 18:19:36.357712 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 148/355] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:36 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:37.373907 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c22e3d03-5d4f-4f47-968f-183222619a52 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:37.374482 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c22e3d03-5d4f-4f47-968f-183222619a52 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:37.380403 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c22e3d03-5d4f-4f47-968f-183222619a52 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:37.380871 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c22e3d03-5d4f-4f47-968f-183222619a52 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:37.381676 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c22e3d03-5d4f-4f47-968f-183222619a52 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:37.382111 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c22e3d03-5d4f-4f47-968f-183222619a52 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:37.505290 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c22e3d03-5d4f-4f47-968f-183222619a52 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:37.513167 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c22e3d03-5d4f-4f47-968f-183222619a52 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.143151 May 17 18:19:37.513761 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 208/356] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:37 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:38.530261 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b2fe490f-b1ba-42a8-bc23-5655d50302ab tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:38.530908 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b2fe490f-b1ba-42a8-bc23-5655d50302ab tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:38.539188 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2fe490f-b1ba-42a8-bc23-5655d50302ab tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:38.540047 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2fe490f-b1ba-42a8-bc23-5655d50302ab tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:38.540905 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2fe490f-b1ba-42a8-bc23-5655d50302ab tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:38.541389 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2fe490f-b1ba-42a8-bc23-5655d50302ab tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:38.674360 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b2fe490f-b1ba-42a8-bc23-5655d50302ab tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:38.682569 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b2fe490f-b1ba-42a8-bc23-5655d50302ab tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.156322 May 17 18:19:38.683243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 149/357] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:38 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:39.699444 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8f0392c6-8be1-43be-abef-13de33aa454a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:39.700087 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-8f0392c6-8be1-43be-abef-13de33aa454a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:39.706143 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8f0392c6-8be1-43be-abef-13de33aa454a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:39.706600 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8f0392c6-8be1-43be-abef-13de33aa454a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:39.707449 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8f0392c6-8be1-43be-abef-13de33aa454a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:39.707923 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8f0392c6-8be1-43be-abef-13de33aa454a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:39.846003 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8f0392c6-8be1-43be-abef-13de33aa454a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:39.853970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8f0392c6-8be1-43be-abef-13de33aa454a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.158591 May 17 18:19:39.854534 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 209/358] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:39 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:40.871476 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5a4a3cf8-f24e-4550-9394-fd9015f978f9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:40.872151 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5a4a3cf8-f24e-4550-9394-fd9015f978f9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:40.878488 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a4a3cf8-f24e-4550-9394-fd9015f978f9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:40.878946 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a4a3cf8-f24e-4550-9394-fd9015f978f9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:40.879712 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a4a3cf8-f24e-4550-9394-fd9015f978f9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:40.880154 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a4a3cf8-f24e-4550-9394-fd9015f978f9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:41.010052 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5a4a3cf8-f24e-4550-9394-fd9015f978f9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:41.017390 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5a4a3cf8-f24e-4550-9394-fd9015f978f9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.150388 May 17 18:19:41.017976 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 150/359] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:40 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:42.033889 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-043a53df-2cfc-4934-a139-ef0bdc7bf884 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:42.035055 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-043a53df-2cfc-4934-a139-ef0bdc7bf884 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:42.040997 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-043a53df-2cfc-4934-a139-ef0bdc7bf884 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:42.041667 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-043a53df-2cfc-4934-a139-ef0bdc7bf884 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:42.042767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-043a53df-2cfc-4934-a139-ef0bdc7bf884 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:42.043317 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-043a53df-2cfc-4934-a139-ef0bdc7bf884 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:42.191533 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-043a53df-2cfc-4934-a139-ef0bdc7bf884 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:42.199980 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-043a53df-2cfc-4934-a139-ef0bdc7bf884 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.169780 May 17 18:19:42.200629 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 210/360] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:42 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:43.217850 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8375a561-7257-4bc6-8df0-5951adabd4ca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:43.218587 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8375a561-7257-4bc6-8df0-5951adabd4ca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:43.224978 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8375a561-7257-4bc6-8df0-5951adabd4ca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:43.225425 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8375a561-7257-4bc6-8df0-5951adabd4ca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:43.226223 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8375a561-7257-4bc6-8df0-5951adabd4ca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:43.226669 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8375a561-7257-4bc6-8df0-5951adabd4ca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:43.351186 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8375a561-7257-4bc6-8df0-5951adabd4ca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:43.359915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8375a561-7257-4bc6-8df0-5951adabd4ca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.146184 May 17 18:19:43.360553 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 151/361] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:43 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:44.378705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-27fad15d-4e58-4c80-bd26-bf5efc46f3d6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:44.379316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-27fad15d-4e58-4c80-bd26-bf5efc46f3d6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:44.385123 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-27fad15d-4e58-4c80-bd26-bf5efc46f3d6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:44.385603 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-27fad15d-4e58-4c80-bd26-bf5efc46f3d6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:44.386442 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-27fad15d-4e58-4c80-bd26-bf5efc46f3d6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:44.386814 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-27fad15d-4e58-4c80-bd26-bf5efc46f3d6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:44.518662 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-27fad15d-4e58-4c80-bd26-bf5efc46f3d6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:44.526396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-27fad15d-4e58-4c80-bd26-bf5efc46f3d6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.151667 May 17 18:19:44.526958 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 211/362] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:44 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:45.543207 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d6a1a161-e812-4912-9ca9-b79406c6b255 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:45.543820 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d6a1a161-e812-4912-9ca9-b79406c6b255 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:45.551208 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d6a1a161-e812-4912-9ca9-b79406c6b255 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:45.551663 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d6a1a161-e812-4912-9ca9-b79406c6b255 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:45.552485 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d6a1a161-e812-4912-9ca9-b79406c6b255 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:45.552926 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d6a1a161-e812-4912-9ca9-b79406c6b255 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:45.682808 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d6a1a161-e812-4912-9ca9-b79406c6b255 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:45.690225 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d6a1a161-e812-4912-9ca9-b79406c6b255 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.150825 May 17 18:19:45.690789 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 152/363] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:45 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:46.707760 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5077a706-f526-474b-b385-78818eb6a6b3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:46.708369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5077a706-f526-474b-b385-78818eb6a6b3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:46.716326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5077a706-f526-474b-b385-78818eb6a6b3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:46.716772 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5077a706-f526-474b-b385-78818eb6a6b3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:46.717567 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5077a706-f526-474b-b385-78818eb6a6b3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:46.718039 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5077a706-f526-474b-b385-78818eb6a6b3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:46.846663 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5077a706-f526-474b-b385-78818eb6a6b3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:46.854153 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5077a706-f526-474b-b385-78818eb6a6b3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.150221 May 17 18:19:46.854721 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 212/364] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:46 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:47.871064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-47eb918a-df01-4ccb-9b59-5e6cbaa2fe0d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:47.871694 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-47eb918a-df01-4ccb-9b59-5e6cbaa2fe0d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:47.878054 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47eb918a-df01-4ccb-9b59-5e6cbaa2fe0d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:47.878505 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47eb918a-df01-4ccb-9b59-5e6cbaa2fe0d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:47.879269 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47eb918a-df01-4ccb-9b59-5e6cbaa2fe0d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:47.879709 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47eb918a-df01-4ccb-9b59-5e6cbaa2fe0d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:48.010898 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-47eb918a-df01-4ccb-9b59-5e6cbaa2fe0d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:48.018308 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-47eb918a-df01-4ccb-9b59-5e6cbaa2fe0d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.151152 May 17 18:19:48.018863 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 153/365] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:47 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:49.035521 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aa5b8320-930a-46f2-b996-2e0b2491e7fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:49.036127 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-aa5b8320-930a-46f2-b996-2e0b2491e7fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:49.042087 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa5b8320-930a-46f2-b996-2e0b2491e7fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:49.042537 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa5b8320-930a-46f2-b996-2e0b2491e7fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:49.043324 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa5b8320-930a-46f2-b996-2e0b2491e7fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:49.043732 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa5b8320-930a-46f2-b996-2e0b2491e7fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:49.171188 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-aa5b8320-930a-46f2-b996-2e0b2491e7fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:49.178539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-aa5b8320-930a-46f2-b996-2e0b2491e7fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.146829 May 17 18:19:49.179297 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 213/366] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:49 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:50.195651 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-76c70602-fc4a-4c79-8034-ab2092e1dcf0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:50.196268 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-76c70602-fc4a-4c79-8034-ab2092e1dcf0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:50.203606 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76c70602-fc4a-4c79-8034-ab2092e1dcf0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:50.204086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76c70602-fc4a-4c79-8034-ab2092e1dcf0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:50.204856 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76c70602-fc4a-4c79-8034-ab2092e1dcf0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:50.205291 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76c70602-fc4a-4c79-8034-ab2092e1dcf0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:50.339276 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-76c70602-fc4a-4c79-8034-ab2092e1dcf0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:50.346751 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-76c70602-fc4a-4c79-8034-ab2092e1dcf0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.154902 May 17 18:19:50.347313 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 154/367] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:50 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:51.276981 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7c6a094a-82d1-40b8-9558-01975de90cce tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3e7577d-578a-43be-b857-e5dbbeaf96dc", "device": "/dev/sdb"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:51.278601 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7c6a094a-82d1-40b8-9558-01975de90cce tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:51.284747 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c6a094a-82d1-40b8-9558-01975de90cce tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.285190 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c6a094a-82d1-40b8-9558-01975de90cce tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.286002 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c6a094a-82d1-40b8-9558-01975de90cce tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.286435 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c6a094a-82d1-40b8-9558-01975de90cce tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.363319 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-271570d2-0479-431d-8a2b-9ed2d0676146 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:51.363948 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-271570d2-0479-431d-8a2b-9ed2d0676146 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:51.374697 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-271570d2-0479-431d-8a2b-9ed2d0676146 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.375163 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-271570d2-0479-431d-8a2b-9ed2d0676146 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.375988 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-271570d2-0479-431d-8a2b-9ed2d0676146 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:51.376438 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-271570d2-0479-431d-8a2b-9ed2d0676146 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:51.520282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-271570d2-0479-431d-8a2b-9ed2d0676146 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:51.527657 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-271570d2-0479-431d-8a2b-9ed2d0676146 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.168287 May 17 18:19:51.528217 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 155/368] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:51 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:52.539301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7c6a094a-82d1-40b8-9558-01975de90cce tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "POST /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.266437 May 17 18:19:52.541505 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 214/369] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:19:51 2022] POST /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029/os-volume_attachments => generated 194 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:19:52.545234 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3acfea15-c3ca-4953-a27e-09b2509e87a9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:52.546033 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-3acfea15-c3ca-4953-a27e-09b2509e87a9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:52.556945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3acfea15-c3ca-4953-a27e-09b2509e87a9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:52.557766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3acfea15-c3ca-4953-a27e-09b2509e87a9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:52.558803 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3acfea15-c3ca-4953-a27e-09b2509e87a9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:52.559612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3acfea15-c3ca-4953-a27e-09b2509e87a9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:52.687919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-3acfea15-c3ca-4953-a27e-09b2509e87a9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:52.695150 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-3acfea15-c3ca-4953-a27e-09b2509e87a9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.154577 May 17 18:19:52.695715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 156/370] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:52 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:19:53.713850 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d29cd177-33b5-4253-8506-38a5891e606b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:53.714458 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d29cd177-33b5-4253-8506-38a5891e606b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:53.720669 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d29cd177-33b5-4253-8506-38a5891e606b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:53.721117 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d29cd177-33b5-4253-8506-38a5891e606b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:53.721976 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d29cd177-33b5-4253-8506-38a5891e606b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:53.722410 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d29cd177-33b5-4253-8506-38a5891e606b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:53.856360 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d29cd177-33b5-4253-8506-38a5891e606b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:53.863627 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d29cd177-33b5-4253-8506-38a5891e606b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.155325 May 17 18:19:53.864181 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 215/371] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:53 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:54.880397 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-47015a3c-e8fa-485c-94a1-fbe35d83442b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:54.881007 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-47015a3c-e8fa-485c-94a1-fbe35d83442b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:54.887332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47015a3c-e8fa-485c-94a1-fbe35d83442b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:54.887787 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47015a3c-e8fa-485c-94a1-fbe35d83442b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:54.888566 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47015a3c-e8fa-485c-94a1-fbe35d83442b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:54.888986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47015a3c-e8fa-485c-94a1-fbe35d83442b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:55.019868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-47015a3c-e8fa-485c-94a1-fbe35d83442b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:55.027150 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-47015a3c-e8fa-485c-94a1-fbe35d83442b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1500 microversion: 2.1 time: 0.150611 May 17 18:19:55.027732 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 157/372] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:54 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1500 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:55.044180 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-22fc901c-8628-4b37-9674-4f6f8d751a25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d9cd494-12e9-4184-bfef-f42ce03455c9"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:55.045549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-22fc901c-8628-4b37-9674-4f6f8d751a25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:55.051969 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22fc901c-8628-4b37-9674-4f6f8d751a25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:55.052419 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22fc901c-8628-4b37-9674-4f6f8d751a25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:55.053188 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22fc901c-8628-4b37-9674-4f6f8d751a25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:55.053651 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22fc901c-8628-4b37-9674-4f6f8d751a25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:55.076696 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-22fc901c-8628-4b37-9674-4f6f8d751a25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] HTTP exception thrown: Cannot 'attach_volume' instance 01e82dfe-21e6-427a-82b1-0b2362423057 while it is in vm_state rescued May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-22fc901c-8628-4b37-9674-4f6f8d751a25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Request method failure captured: May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: POST /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057/os-volume_attachments HTTP/1.1 May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 74 May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bPT5PJb4v2TtchlazaTc4tsgElmPs7hEcTqQ-3XK5tZM_VLzGHdXJdr2rSJCb1gYx1SrW3nB-whM3bgmSozRTJNa1tqgL318uDZXw6jKtkeLg2QsgmksivrEql1pdoXv8CkKOVUB4re9ufg_nU903_wvc0E5GAJ53_vzIvqUBewKo May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: b7d713a65f9e4071988e5df2fbf90b17 May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:19:55.078389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: b7d713a65f9e4071988e5df2fbf90b17 May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-ServerRescueNegativeTestJSON-510098100-project May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 5e6f035cadd24a59803eec21c7b9e2c5 May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-ServerRescueNegativeTestJSON-510098100-project May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {"volumeAttachment": {"volumeId": "7d9cd494-12e9-4184-bfef-f42ce03455c9"}} May 17 18:19:55.079887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Cannot 'attach_volume' instance 01e82dfe-21e6-427a-82b1-0b2362423057 while it is in vm_state rescued May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'server_id': '01e82dfe-21e6-427a-82b1-0b2362423057', 'body': {'volumeAttachment': {'volumeId': '7d9cd494-12e9-4184-bfef-f42ce03455c9'}}} May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01e82dfe-21e6-427a-82b1-0b2362423057 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:19:55.080836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 01e82dfe-21e6-427a-82b1-0b2362423057 while it is in vm_state rescued May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:19:55.082358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:19:55.083740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:19:55.083740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:19:55.083740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 01e82dfe-21e6-427a-82b1-0b2362423057 while it is in vm_state rescued May 17 18:19:55.083740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:19:55.083740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-22fc901c-8628-4b37-9674-4f6f8d751a25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Returning 409 to user: Cannot 'attach_volume' instance 01e82dfe-21e6-427a-82b1-0b2362423057 while it is in vm_state rescued {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:19:55.083740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-22fc901c-8628-4b37-9674-4f6f8d751a25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "POST /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040506 May 17 18:19:55.083740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 216/373] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:19:55 2022] POST /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 17 18:19:55.089268 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9418b649-b1f2-444d-bca3-fdfdfb284376 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:19:55.089886 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-9418b649-b1f2-444d-bca3-fdfdfb284376 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:55.096505 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9418b649-b1f2-444d-bca3-fdfdfb284376 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:55.096963 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9418b649-b1f2-444d-bca3-fdfdfb284376 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:55.097797 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9418b649-b1f2-444d-bca3-fdfdfb284376 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:55.098241 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9418b649-b1f2-444d-bca3-fdfdfb284376 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:55.164974 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9418b649-b1f2-444d-bca3-fdfdfb284376 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "POST /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057/action" status: 202 len: 0 microversion: 2.1 time: 0.079749 May 17 18:19:55.166120 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 158/374] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:19:55 2022] POST /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 18:19:55.174197 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fd840ad9-b831-4308-8747-6e496aa816ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:55.174806 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fd840ad9-b831-4308-8747-6e496aa816ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:55.180903 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd840ad9-b831-4308-8747-6e496aa816ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:55.181977 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd840ad9-b831-4308-8747-6e496aa816ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:55.182795 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd840ad9-b831-4308-8747-6e496aa816ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:55.183229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd840ad9-b831-4308-8747-6e496aa816ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:55.322873 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fd840ad9-b831-4308-8747-6e496aa816ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:55.330551 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fd840ad9-b831-4308-8747-6e496aa816ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1508 microversion: 2.1 time: 0.160146 May 17 18:19:55.331116 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 217/375] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:55 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:56.349526 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-bea4372d-87d1-466f-87c5-b472b0333a36 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:56.350260 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-bea4372d-87d1-466f-87c5-b472b0333a36 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:56.357639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bea4372d-87d1-466f-87c5-b472b0333a36 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:56.358106 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bea4372d-87d1-466f-87c5-b472b0333a36 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:56.358873 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bea4372d-87d1-466f-87c5-b472b0333a36 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:56.359311 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bea4372d-87d1-466f-87c5-b472b0333a36 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:56.485757 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bea4372d-87d1-466f-87c5-b472b0333a36 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:56.493190 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-bea4372d-87d1-466f-87c5-b472b0333a36 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1508 microversion: 2.1 time: 0.149147 May 17 18:19:56.494369 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 159/376] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:56 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:57.510607 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4c929653-4805-4d61-9b03-eb1657093456 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:57.511228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4c929653-4805-4d61-9b03-eb1657093456 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:57.517689 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4c929653-4805-4d61-9b03-eb1657093456 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:57.518139 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4c929653-4805-4d61-9b03-eb1657093456 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:57.518912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4c929653-4805-4d61-9b03-eb1657093456 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:57.519352 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4c929653-4805-4d61-9b03-eb1657093456 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:57.646217 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4c929653-4805-4d61-9b03-eb1657093456 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:57.653832 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4c929653-4805-4d61-9b03-eb1657093456 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1508 microversion: 2.1 time: 0.147037 May 17 18:19:57.654388 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 218/377] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:57 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:58.670893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e176c15a-9c31-49c9-b2ff-e2f48220b8c9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:58.671583 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e176c15a-9c31-49c9-b2ff-e2f48220b8c9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:58.677907 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e176c15a-9c31-49c9-b2ff-e2f48220b8c9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:58.678366 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e176c15a-9c31-49c9-b2ff-e2f48220b8c9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:58.679139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e176c15a-9c31-49c9-b2ff-e2f48220b8c9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:58.679591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e176c15a-9c31-49c9-b2ff-e2f48220b8c9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:58.802842 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e176c15a-9c31-49c9-b2ff-e2f48220b8c9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:58.810975 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e176c15a-9c31-49c9-b2ff-e2f48220b8c9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1508 microversion: 2.1 time: 0.143886 May 17 18:19:58.811545 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 160/378] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:58 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1508 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:19:59.828735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-355120c6-3630-45cc-9482-2291987387cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:19:59.829390 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-355120c6-3630-45cc-9482-2291987387cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:19:59.835975 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-355120c6-3630-45cc-9482-2291987387cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:59.836432 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-355120c6-3630-45cc-9482-2291987387cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:59.837212 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-355120c6-3630-45cc-9482-2291987387cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:19:59.837682 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-355120c6-3630-45cc-9482-2291987387cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:19:59.965164 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-355120c6-3630-45cc-9482-2291987387cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:19:59.972676 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-355120c6-3630-45cc-9482-2291987387cb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1508 microversion: 2.1 time: 0.147600 May 17 18:19:59.973236 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 219/379] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:19:59 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:00.989110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c600f2b0-37e5-468b-af11-0733ffda363c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:00.989782 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c600f2b0-37e5-468b-af11-0733ffda363c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:00.996712 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c600f2b0-37e5-468b-af11-0733ffda363c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:00.997161 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c600f2b0-37e5-468b-af11-0733ffda363c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:00.997957 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c600f2b0-37e5-468b-af11-0733ffda363c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:00.998392 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c600f2b0-37e5-468b-af11-0733ffda363c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:01.140981 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c600f2b0-37e5-468b-af11-0733ffda363c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:01.148327 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c600f2b0-37e5-468b-af11-0733ffda363c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1514 microversion: 2.1 time: 0.163109 May 17 18:20:01.148882 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 161/380] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:00 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:02.481533 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b33d241a-d2d1-41b6-ab32-e4ad050ad8f6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Action: 'create', calling method: .version_select at 0x7f4e5b50c790>, body: {"keypair": {"name": "tempest-keypair-1032767693", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCPL2CEAeO6v0sASJmqZpLTigd2F+CRI9QDTrZXFDGvKVVlqFwvJ+IgmUUkfelKuYf3WmN83dGjUbmlG6eCZdCV5MpZLdy/MyxnlMiBCaFhmrZ0mNN7mGGrj94W4ZRFA9g=="}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:02.496862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-b33d241a-d2d1-41b6-ab32-e4ad050ad8f6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Getting quotas for project b7d713a65f9e4071988e5df2fbf90b17. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:20:02.500700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-b33d241a-d2d1-41b6-ab32-e4ad050ad8f6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Getting quotas for user 5e6f035cadd24a59803eec21c7b9e2c5 and project b7d713a65f9e4071988e5df2fbf90b17. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:20:02.522292 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b33d241a-d2d1-41b6-ab32-e4ad050ad8f6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045082 May 17 18:20:02.522883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 220/381] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 17 18:20:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:20:03.691199 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1119454807", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3108c074-e89d-458b-b4f7-22798aa06562"}], "security_groups": [{"name": "tempest-securitygroup--608609375"}], "key_name": "tempest-keypair-1032767693", "user_data": "}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:03.792388 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] validate_networks() for [('3108c074-e89d-458b-b4f7-22798aa06562', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:20:04.144547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:20:04.144959 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:20:04.145485 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:20:04.145903 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:20:04.146324 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:20:04.155590 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:04.156044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:04.156853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:04.157296 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:04.173647 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Getting quotas for project b7d713a65f9e4071988e5df2fbf90b17. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:20:04.177546 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Getting quotas for user 5e6f035cadd24a59803eec21c7b9e2c5 and project b7d713a65f9e4071988e5df2fbf90b17. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:20:04.189003 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:20:04.191293 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:20:04.236185 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b8cb3220-9e09-48e4-8559-9091ec9ef87c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.549229 May 17 18:20:04.236819 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 162/382] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:20:03 2022] POST /compute/v2.1/servers => generated 408 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:20:04.247774 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6e30021e-2c9d-49bc-9a5a-733b3761bf56 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:04.248384 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6e30021e-2c9d-49bc-9a5a-733b3761bf56 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:04.304671 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6e30021e-2c9d-49bc-9a5a-733b3761bf56 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:04.312685 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6e30021e-2c9d-49bc-9a5a-733b3761bf56 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1246 microversion: 2.1 time: 0.069738 May 17 18:20:04.313449 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 221/383] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:04 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1246 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:05.331081 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e0ada4d7-abf0-457b-8e3e-554efa3d3bfa tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:05.331692 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e0ada4d7-abf0-457b-8e3e-554efa3d3bfa tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:05.337730 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0ada4d7-abf0-457b-8e3e-554efa3d3bfa tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:05.338180 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0ada4d7-abf0-457b-8e3e-554efa3d3bfa tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:05.338938 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0ada4d7-abf0-457b-8e3e-554efa3d3bfa tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:05.339376 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0ada4d7-abf0-457b-8e3e-554efa3d3bfa tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:05.399913 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e0ada4d7-abf0-457b-8e3e-554efa3d3bfa tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:05.408186 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e0ada4d7-abf0-457b-8e3e-554efa3d3bfa tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1250 microversion: 2.1 time: 0.081217 May 17 18:20:05.414284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 163/384] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:05 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:06.424584 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5159880f-4167-4c21-9265-004b6cfba4e3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:06.425206 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5159880f-4167-4c21-9265-004b6cfba4e3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:06.432560 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5159880f-4167-4c21-9265-004b6cfba4e3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:06.433011 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5159880f-4167-4c21-9265-004b6cfba4e3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:06.433821 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5159880f-4167-4c21-9265-004b6cfba4e3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:06.434259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5159880f-4167-4c21-9265-004b6cfba4e3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:06.495034 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5159880f-4167-4c21-9265-004b6cfba4e3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:06.502269 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5159880f-4167-4c21-9265-004b6cfba4e3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1250 microversion: 2.1 time: 0.081491 May 17 18:20:06.502830 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 222/385] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:06 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:07.518537 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7e1f9aa2-34e0-497b-8aa4-02166dd4dcdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:07.519153 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7e1f9aa2-34e0-497b-8aa4-02166dd4dcdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:07.525605 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7e1f9aa2-34e0-497b-8aa4-02166dd4dcdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:07.526062 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7e1f9aa2-34e0-497b-8aa4-02166dd4dcdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:07.526831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7e1f9aa2-34e0-497b-8aa4-02166dd4dcdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:07.527271 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7e1f9aa2-34e0-497b-8aa4-02166dd4dcdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:07.586675 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7e1f9aa2-34e0-497b-8aa4-02166dd4dcdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:07.593956 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7e1f9aa2-34e0-497b-8aa4-02166dd4dcdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1250 microversion: 2.1 time: 0.079245 May 17 18:20:07.594512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 164/386] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:07 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1250 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:08.610579 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d8a0a1ac-49ef-4f2d-8981-d74b01434db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:08.611200 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d8a0a1ac-49ef-4f2d-8981-d74b01434db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:08.617479 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8a0a1ac-49ef-4f2d-8981-d74b01434db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:08.617944 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8a0a1ac-49ef-4f2d-8981-d74b01434db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:08.619331 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8a0a1ac-49ef-4f2d-8981-d74b01434db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:08.619772 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8a0a1ac-49ef-4f2d-8981-d74b01434db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:08.680164 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d8a0a1ac-49ef-4f2d-8981-d74b01434db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:08.688044 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d8a0a1ac-49ef-4f2d-8981-d74b01434db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1242 microversion: 2.1 time: 0.081234 May 17 18:20:08.688598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 223/387] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:08 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:09.704726 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-def534e6-4d6c-4fb4-b2e8-c0b3d5234313 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:09.705334 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-def534e6-4d6c-4fb4-b2e8-c0b3d5234313 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:09.713219 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-def534e6-4d6c-4fb4-b2e8-c0b3d5234313 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:09.713739 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-def534e6-4d6c-4fb4-b2e8-c0b3d5234313 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:09.714509 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-def534e6-4d6c-4fb4-b2e8-c0b3d5234313 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:09.714951 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-def534e6-4d6c-4fb4-b2e8-c0b3d5234313 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:09.781268 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-def534e6-4d6c-4fb4-b2e8-c0b3d5234313 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:09.788471 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-def534e6-4d6c-4fb4-b2e8-c0b3d5234313 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1298 microversion: 2.1 time: 0.087614 May 17 18:20:09.789029 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 165/388] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:09 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:20:10.807773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e67623b0-5509-4366-81a9-f6153b52eaa3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:10.808508 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e67623b0-5509-4366-81a9-f6153b52eaa3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:10.815169 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e67623b0-5509-4366-81a9-f6153b52eaa3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:10.815713 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e67623b0-5509-4366-81a9-f6153b52eaa3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:10.816595 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e67623b0-5509-4366-81a9-f6153b52eaa3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:10.817140 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e67623b0-5509-4366-81a9-f6153b52eaa3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:10.960472 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e67623b0-5509-4366-81a9-f6153b52eaa3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:10.968557 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e67623b0-5509-4366-81a9-f6153b52eaa3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.165303 May 17 18:20:10.969132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 224/389] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:10 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:11.986051 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7d5aed7b-2ece-481d-97f5-fe20e40c78ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:11.986669 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7d5aed7b-2ece-481d-97f5-fe20e40c78ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:11.993605 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7d5aed7b-2ece-481d-97f5-fe20e40c78ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:11.994005 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7d5aed7b-2ece-481d-97f5-fe20e40c78ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:11.994775 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7d5aed7b-2ece-481d-97f5-fe20e40c78ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:11.995218 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7d5aed7b-2ece-481d-97f5-fe20e40c78ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:12.121917 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7d5aed7b-2ece-481d-97f5-fe20e40c78ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:12.129474 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7d5aed7b-2ece-481d-97f5-fe20e40c78ac tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.147231 May 17 18:20:12.130243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 166/390] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:11 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:12.707911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-743813b7-6c3b-4cfd-825c-55f8f7990612 req-36513b6a-755d-486d-b64e-3aaf0d159fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94d1524-97f8-49d7-8685-184066d438d2", "tag": "08d646aa-87c5-4998-abe8-ddbc4d06f4f0"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:12.720172 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-743813b7-6c3b-4cfd-825c-55f8f7990612 req-36513b6a-755d-486d-b64e-3aaf0d159fc2 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:12.720988 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-743813b7-6c3b-4cfd-825c-55f8f7990612 req-36513b6a-755d-486d-b64e-3aaf0d159fc2 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:12.737895 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-743813b7-6c3b-4cfd-825c-55f8f7990612 req-36513b6a-755d-486d-b64e-3aaf0d159fc2 service nova] Creating event network-changed:08d646aa-87c5-4998-abe8-ddbc4d06f4f0 for instance b94d1524-97f8-49d7-8685-184066d438d2 on hv-cinder-83736 May 17 18:20:12.742959 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-743813b7-6c3b-4cfd-825c-55f8f7990612 req-36513b6a-755d-486d-b64e-3aaf0d159fc2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040254 May 17 18:20:12.746886 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 225/391] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:20:13.145701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-90556ada-c8c9-45ec-8527-efd98056e222 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:13.146319 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-90556ada-c8c9-45ec-8527-efd98056e222 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:13.153258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-90556ada-c8c9-45ec-8527-efd98056e222 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:13.153742 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-90556ada-c8c9-45ec-8527-efd98056e222 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:13.154512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-90556ada-c8c9-45ec-8527-efd98056e222 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:13.154956 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-90556ada-c8c9-45ec-8527-efd98056e222 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:13.280693 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-90556ada-c8c9-45ec-8527-efd98056e222 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:13.290544 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-90556ada-c8c9-45ec-8527-efd98056e222 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.148652 May 17 18:20:13.291105 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 167/392] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:13 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:14.308425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3e82c521-8c70-4219-9d58-eddfdd9d0283 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:14.309143 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3e82c521-8c70-4219-9d58-eddfdd9d0283 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:14.315530 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3e82c521-8c70-4219-9d58-eddfdd9d0283 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:14.316020 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3e82c521-8c70-4219-9d58-eddfdd9d0283 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:14.316804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3e82c521-8c70-4219-9d58-eddfdd9d0283 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:14.317275 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3e82c521-8c70-4219-9d58-eddfdd9d0283 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:14.444305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3e82c521-8c70-4219-9d58-eddfdd9d0283 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:14.452194 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3e82c521-8c70-4219-9d58-eddfdd9d0283 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.148563 May 17 18:20:14.452742 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 226/393] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:14 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:15.468925 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e3104ae0-6d19-476d-844e-db2b75c68160 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:15.469564 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e3104ae0-6d19-476d-844e-db2b75c68160 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:15.475816 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3104ae0-6d19-476d-844e-db2b75c68160 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:15.476268 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3104ae0-6d19-476d-844e-db2b75c68160 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:15.477041 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3104ae0-6d19-476d-844e-db2b75c68160 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:15.478125 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3104ae0-6d19-476d-844e-db2b75c68160 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:15.610118 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e3104ae0-6d19-476d-844e-db2b75c68160 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:15.617314 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e3104ae0-6d19-476d-844e-db2b75c68160 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.152275 May 17 18:20:15.617931 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 168/394] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:15 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:16.634067 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0b9d3515-dd2f-4f84-9427-fafe7b4701c0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:16.634675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0b9d3515-dd2f-4f84-9427-fafe7b4701c0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:16.640971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0b9d3515-dd2f-4f84-9427-fafe7b4701c0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:16.641425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0b9d3515-dd2f-4f84-9427-fafe7b4701c0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:16.642216 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0b9d3515-dd2f-4f84-9427-fafe7b4701c0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:16.642656 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0b9d3515-dd2f-4f84-9427-fafe7b4701c0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:16.770430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0b9d3515-dd2f-4f84-9427-fafe7b4701c0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:16.777612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0b9d3515-dd2f-4f84-9427-fafe7b4701c0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.147370 May 17 18:20:16.778174 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 227/395] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:16 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:17.794271 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-98b325f4-6a56-4d8e-9b87-774e9f44b5cd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:17.794826 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-98b325f4-6a56-4d8e-9b87-774e9f44b5cd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:17.801224 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-98b325f4-6a56-4d8e-9b87-774e9f44b5cd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:17.801704 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-98b325f4-6a56-4d8e-9b87-774e9f44b5cd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:17.802470 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-98b325f4-6a56-4d8e-9b87-774e9f44b5cd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:17.802906 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-98b325f4-6a56-4d8e-9b87-774e9f44b5cd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:17.930805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-98b325f4-6a56-4d8e-9b87-774e9f44b5cd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:17.938007 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-98b325f4-6a56-4d8e-9b87-774e9f44b5cd tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.147633 May 17 18:20:17.938558 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 169/396] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:17 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:18.955340 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d50f3b7a-5adc-4a4b-8fc1-606513b31f99 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:18.955964 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d50f3b7a-5adc-4a4b-8fc1-606513b31f99 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:18.963000 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d50f3b7a-5adc-4a4b-8fc1-606513b31f99 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:18.963455 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d50f3b7a-5adc-4a4b-8fc1-606513b31f99 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:18.964231 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d50f3b7a-5adc-4a4b-8fc1-606513b31f99 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:18.964693 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d50f3b7a-5adc-4a4b-8fc1-606513b31f99 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:19.089067 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d50f3b7a-5adc-4a4b-8fc1-606513b31f99 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:19.096356 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d50f3b7a-5adc-4a4b-8fc1-606513b31f99 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.144858 May 17 18:20:19.096915 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 228/397] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:18 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:20.113096 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-06e8ae21-9dbf-4c30-80fd-1a0fff3f5947 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:20.113748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-06e8ae21-9dbf-4c30-80fd-1a0fff3f5947 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:20.119986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-06e8ae21-9dbf-4c30-80fd-1a0fff3f5947 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:20.120442 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-06e8ae21-9dbf-4c30-80fd-1a0fff3f5947 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:20.121208 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-06e8ae21-9dbf-4c30-80fd-1a0fff3f5947 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:20.121673 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-06e8ae21-9dbf-4c30-80fd-1a0fff3f5947 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:20.247295 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-06e8ae21-9dbf-4c30-80fd-1a0fff3f5947 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:20.254539 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-06e8ae21-9dbf-4c30-80fd-1a0fff3f5947 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.145180 May 17 18:20:20.255104 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 170/398] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:20 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:21.270612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4945d072-b5c4-43da-a4ba-e6c9587e6566 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:21.271158 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4945d072-b5c4-43da-a4ba-e6c9587e6566 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:21.277483 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4945d072-b5c4-43da-a4ba-e6c9587e6566 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:21.277933 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4945d072-b5c4-43da-a4ba-e6c9587e6566 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:21.278690 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4945d072-b5c4-43da-a4ba-e6c9587e6566 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:21.279123 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4945d072-b5c4-43da-a4ba-e6c9587e6566 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:21.401839 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4945d072-b5c4-43da-a4ba-e6c9587e6566 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:21.408936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4945d072-b5c4-43da-a4ba-e6c9587e6566 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.142243 May 17 18:20:21.409498 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 229/399] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:21 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:22.426422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f3ce9ad9-7110-4d80-9597-ed010d355db2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:22.427071 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f3ce9ad9-7110-4d80-9597-ed010d355db2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:22.432985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f3ce9ad9-7110-4d80-9597-ed010d355db2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:22.433437 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f3ce9ad9-7110-4d80-9597-ed010d355db2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:22.434226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f3ce9ad9-7110-4d80-9597-ed010d355db2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:22.434668 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f3ce9ad9-7110-4d80-9597-ed010d355db2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:22.570138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f3ce9ad9-7110-4d80-9597-ed010d355db2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:22.578098 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f3ce9ad9-7110-4d80-9597-ed010d355db2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.155655 May 17 18:20:22.578649 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 171/400] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:22 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:23.595005 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-30436eaa-ec4c-4ae1-9354-8f46c884f4ea tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:23.595619 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-30436eaa-ec4c-4ae1-9354-8f46c884f4ea tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:23.602021 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-30436eaa-ec4c-4ae1-9354-8f46c884f4ea tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:23.602478 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-30436eaa-ec4c-4ae1-9354-8f46c884f4ea tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:23.603243 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-30436eaa-ec4c-4ae1-9354-8f46c884f4ea tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:23.603682 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-30436eaa-ec4c-4ae1-9354-8f46c884f4ea tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:23.728439 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-30436eaa-ec4c-4ae1-9354-8f46c884f4ea tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:23.735695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-30436eaa-ec4c-4ae1-9354-8f46c884f4ea tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.144515 May 17 18:20:23.736260 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 230/401] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:23 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:24.752225 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c910117e-8bee-4c6d-a4dd-0206f31fcf2e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:24.752831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c910117e-8bee-4c6d-a4dd-0206f31fcf2e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:24.759097 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c910117e-8bee-4c6d-a4dd-0206f31fcf2e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:24.759544 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c910117e-8bee-4c6d-a4dd-0206f31fcf2e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:24.760937 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c910117e-8bee-4c6d-a4dd-0206f31fcf2e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:24.761373 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c910117e-8bee-4c6d-a4dd-0206f31fcf2e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:24.884801 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c910117e-8bee-4c6d-a4dd-0206f31fcf2e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:24.892074 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c910117e-8bee-4c6d-a4dd-0206f31fcf2e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.143976 May 17 18:20:24.892642 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 172/402] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:24 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:25.908779 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-341ed888-e6be-4f90-a793-ab643fb6926e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:25.909389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-341ed888-e6be-4f90-a793-ab643fb6926e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:25.915713 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-341ed888-e6be-4f90-a793-ab643fb6926e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:25.916161 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-341ed888-e6be-4f90-a793-ab643fb6926e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:25.916926 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-341ed888-e6be-4f90-a793-ab643fb6926e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:25.917620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-341ed888-e6be-4f90-a793-ab643fb6926e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:26.044426 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-341ed888-e6be-4f90-a793-ab643fb6926e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:26.051637 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-341ed888-e6be-4f90-a793-ab643fb6926e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.146685 May 17 18:20:26.052201 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 231/403] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:25 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:27.068822 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ec0f1827-f73f-45c4-9146-71b4a9a31d7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:27.069518 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ec0f1827-f73f-45c4-9146-71b4a9a31d7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:27.076612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec0f1827-f73f-45c4-9146-71b4a9a31d7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:27.077067 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec0f1827-f73f-45c4-9146-71b4a9a31d7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:27.077868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec0f1827-f73f-45c4-9146-71b4a9a31d7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:27.078311 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec0f1827-f73f-45c4-9146-71b4a9a31d7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:27.201208 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ec0f1827-f73f-45c4-9146-71b4a9a31d7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:27.208412 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ec0f1827-f73f-45c4-9146-71b4a9a31d7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.143529 May 17 18:20:27.208985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 173/404] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:27 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:28.225835 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c6752847-0d54-45ae-9b85-0f0da265015c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:28.226451 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c6752847-0d54-45ae-9b85-0f0da265015c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:28.234274 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6752847-0d54-45ae-9b85-0f0da265015c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:28.234933 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6752847-0d54-45ae-9b85-0f0da265015c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:28.236237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6752847-0d54-45ae-9b85-0f0da265015c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:28.236991 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6752847-0d54-45ae-9b85-0f0da265015c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:28.365561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c6752847-0d54-45ae-9b85-0f0da265015c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:28.372743 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c6752847-0d54-45ae-9b85-0f0da265015c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.150763 May 17 18:20:28.373304 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 232/405] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:28 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:29.389077 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b84fd1f5-2223-4565-b11a-28c88671ba0e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:29.389724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b84fd1f5-2223-4565-b11a-28c88671ba0e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:29.395977 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b84fd1f5-2223-4565-b11a-28c88671ba0e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:29.396423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b84fd1f5-2223-4565-b11a-28c88671ba0e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:29.397180 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b84fd1f5-2223-4565-b11a-28c88671ba0e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:29.397657 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b84fd1f5-2223-4565-b11a-28c88671ba0e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:29.523987 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b84fd1f5-2223-4565-b11a-28c88671ba0e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:29.532269 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b84fd1f5-2223-4565-b11a-28c88671ba0e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.146935 May 17 18:20:29.544092 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 174/406] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:29 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:30.548645 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-99233260-93e7-424b-b9bf-d38f231e5bf9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:30.549256 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-99233260-93e7-424b-b9bf-d38f231e5bf9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:30.555826 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-99233260-93e7-424b-b9bf-d38f231e5bf9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:30.556276 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-99233260-93e7-424b-b9bf-d38f231e5bf9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:30.557047 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-99233260-93e7-424b-b9bf-d38f231e5bf9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:30.557496 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-99233260-93e7-424b-b9bf-d38f231e5bf9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:30.681045 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-99233260-93e7-424b-b9bf-d38f231e5bf9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:30.688283 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-99233260-93e7-424b-b9bf-d38f231e5bf9 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.143507 May 17 18:20:30.688837 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 233/407] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:30 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:31.704122 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-50e78bb7-8820-4456-a081-c987b860c23a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:31.704734 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-50e78bb7-8820-4456-a081-c987b860c23a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:31.710973 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-50e78bb7-8820-4456-a081-c987b860c23a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:31.711422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-50e78bb7-8820-4456-a081-c987b860c23a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:31.712188 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-50e78bb7-8820-4456-a081-c987b860c23a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:31.712621 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-50e78bb7-8820-4456-a081-c987b860c23a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:31.844683 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-50e78bb7-8820-4456-a081-c987b860c23a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:31.851956 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-50e78bb7-8820-4456-a081-c987b860c23a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.151572 May 17 18:20:31.852518 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 175/408] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:31 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:32.869200 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7d16d0b3-2b09-4576-b079-f751be1cb119 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:32.869840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7d16d0b3-2b09-4576-b079-f751be1cb119 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:32.876681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7d16d0b3-2b09-4576-b079-f751be1cb119 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:32.877131 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7d16d0b3-2b09-4576-b079-f751be1cb119 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:32.877930 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7d16d0b3-2b09-4576-b079-f751be1cb119 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:32.878372 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7d16d0b3-2b09-4576-b079-f751be1cb119 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:33.002171 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7d16d0b3-2b09-4576-b079-f751be1cb119 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:33.009516 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7d16d0b3-2b09-4576-b079-f751be1cb119 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.144082 May 17 18:20:33.010089 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 234/409] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:32 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:34.029249 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ab6630e6-dae4-400e-a38d-b8c6df501723 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:34.029916 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ab6630e6-dae4-400e-a38d-b8c6df501723 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:34.036733 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ab6630e6-dae4-400e-a38d-b8c6df501723 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:34.037521 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ab6630e6-dae4-400e-a38d-b8c6df501723 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:34.038144 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ab6630e6-dae4-400e-a38d-b8c6df501723 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:34.038602 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ab6630e6-dae4-400e-a38d-b8c6df501723 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:34.211954 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ab6630e6-dae4-400e-a38d-b8c6df501723 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:34.220755 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ab6630e6-dae4-400e-a38d-b8c6df501723 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.197250 May 17 18:20:34.222775 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 176/410] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:34 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:35.239104 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7e1f34b7-c3b3-4ad4-804e-d8bf47b274a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:35.239854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7e1f34b7-c3b3-4ad4-804e-d8bf47b274a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:35.247411 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7e1f34b7-c3b3-4ad4-804e-d8bf47b274a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:35.247854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7e1f34b7-c3b3-4ad4-804e-d8bf47b274a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:35.248634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7e1f34b7-c3b3-4ad4-804e-d8bf47b274a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:35.249067 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7e1f34b7-c3b3-4ad4-804e-d8bf47b274a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:35.395830 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7e1f34b7-c3b3-4ad4-804e-d8bf47b274a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:35.403889 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7e1f34b7-c3b3-4ad4-804e-d8bf47b274a0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.168489 May 17 18:20:35.413323 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 235/411] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:35 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:35.435978 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-3a796067-0e2a-46f7-a059-6e82a8adef33 req-7c1a05dd-2ffd-42e4-a35a-d3248c154d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94d1524-97f8-49d7-8685-184066d438d2", "name": "network-vif-plugged", "status": "completed", "tag": "08d646aa-87c5-4998-abe8-ddbc4d06f4f0"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:35.446401 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-3a796067-0e2a-46f7-a059-6e82a8adef33 req-7c1a05dd-2ffd-42e4-a35a-d3248c154d72 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:35.447531 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-3a796067-0e2a-46f7-a059-6e82a8adef33 req-7c1a05dd-2ffd-42e4-a35a-d3248c154d72 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:35.459331 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-3a796067-0e2a-46f7-a059-6e82a8adef33 req-7c1a05dd-2ffd-42e4-a35a-d3248c154d72 service nova] Creating event network-vif-plugged:08d646aa-87c5-4998-abe8-ddbc4d06f4f0 for instance b94d1524-97f8-49d7-8685-184066d438d2 on hv-cinder-83736 May 17 18:20:35.466299 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-3a796067-0e2a-46f7-a059-6e82a8adef33 req-7c1a05dd-2ffd-42e4-a35a-d3248c154d72 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 May 17 18:20:35.467460 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 177/412] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:20:36.420457 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-dd1d8279-b781-40da-80a7-a91a311b364c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:36.421072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-dd1d8279-b781-40da-80a7-a91a311b364c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:36.428017 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dd1d8279-b781-40da-80a7-a91a311b364c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:36.428474 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dd1d8279-b781-40da-80a7-a91a311b364c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:36.429335 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dd1d8279-b781-40da-80a7-a91a311b364c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:36.429914 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dd1d8279-b781-40da-80a7-a91a311b364c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:36.559624 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-dd1d8279-b781-40da-80a7-a91a311b364c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:36.567681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-dd1d8279-b781-40da-80a7-a91a311b364c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.151541 May 17 18:20:36.568261 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 236/413] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:36 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:37.584541 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c9d8234e-92aa-4d1c-9d4e-cfb18e886064 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:37.585259 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c9d8234e-92aa-4d1c-9d4e-cfb18e886064 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:37.594911 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c9d8234e-92aa-4d1c-9d4e-cfb18e886064 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:37.595890 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c9d8234e-92aa-4d1c-9d4e-cfb18e886064 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:37.596877 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c9d8234e-92aa-4d1c-9d4e-cfb18e886064 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:37.597323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c9d8234e-92aa-4d1c-9d4e-cfb18e886064 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:37.726755 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c9d8234e-92aa-4d1c-9d4e-cfb18e886064 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:37.733996 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c9d8234e-92aa-4d1c-9d4e-cfb18e886064 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.153646 May 17 18:20:37.734564 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 178/414] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:37 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:38.750740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7c3f8fed-05a2-4b82-8a90-6e8026f70e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:38.751342 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7c3f8fed-05a2-4b82-8a90-6e8026f70e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:38.757881 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c3f8fed-05a2-4b82-8a90-6e8026f70e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:38.758354 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c3f8fed-05a2-4b82-8a90-6e8026f70e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:38.759130 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c3f8fed-05a2-4b82-8a90-6e8026f70e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:38.759595 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c3f8fed-05a2-4b82-8a90-6e8026f70e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:38.887077 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7c3f8fed-05a2-4b82-8a90-6e8026f70e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:38.894681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7c3f8fed-05a2-4b82-8a90-6e8026f70e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.147816 May 17 18:20:38.895348 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 237/415] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:38 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:39.912545 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-45d29a0a-1368-4b04-8fde-5d2276d1cf07 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:39.913225 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-45d29a0a-1368-4b04-8fde-5d2276d1cf07 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:39.920020 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-45d29a0a-1368-4b04-8fde-5d2276d1cf07 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:39.920476 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-45d29a0a-1368-4b04-8fde-5d2276d1cf07 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:39.921239 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-45d29a0a-1368-4b04-8fde-5d2276d1cf07 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:39.921703 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-45d29a0a-1368-4b04-8fde-5d2276d1cf07 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:40.048528 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-45d29a0a-1368-4b04-8fde-5d2276d1cf07 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:40.055667 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-45d29a0a-1368-4b04-8fde-5d2276d1cf07 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.147153 May 17 18:20:40.056224 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 179/416] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:39 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:41.072278 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4a4587f4-23a4-4c3e-bd11-83b3dfb00db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:41.073635 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4a4587f4-23a4-4c3e-bd11-83b3dfb00db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:41.080428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a4587f4-23a4-4c3e-bd11-83b3dfb00db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:41.080877 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a4587f4-23a4-4c3e-bd11-83b3dfb00db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:41.081668 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a4587f4-23a4-4c3e-bd11-83b3dfb00db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:41.082103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a4587f4-23a4-4c3e-bd11-83b3dfb00db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:41.203462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4a4587f4-23a4-4c3e-bd11-83b3dfb00db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:41.210635 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4a4587f4-23a4-4c3e-bd11-83b3dfb00db3 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.142597 May 17 18:20:41.211192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 238/417] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:41 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:42.227526 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5aa7dad9-d25b-47e6-913c-a88cc85d6cd1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:42.228141 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5aa7dad9-d25b-47e6-913c-a88cc85d6cd1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:42.234515 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5aa7dad9-d25b-47e6-913c-a88cc85d6cd1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:42.234969 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5aa7dad9-d25b-47e6-913c-a88cc85d6cd1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:42.235737 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5aa7dad9-d25b-47e6-913c-a88cc85d6cd1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:42.236176 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5aa7dad9-d25b-47e6-913c-a88cc85d6cd1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:42.365050 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5aa7dad9-d25b-47e6-913c-a88cc85d6cd1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:42.372787 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5aa7dad9-d25b-47e6-913c-a88cc85d6cd1 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1371 microversion: 2.1 time: 0.149105 May 17 18:20:42.373349 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 180/418] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:42 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:43.102338 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-34c4f13e-a103-44d8-81bb-1106347f71aa tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:43.102849 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-34c4f13e-a103-44d8-81bb-1106347f71aa tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:43.109681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-34c4f13e-a103-44d8-81bb-1106347f71aa tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:43.110124 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-34c4f13e-a103-44d8-81bb-1106347f71aa tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:43.110883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-34c4f13e-a103-44d8-81bb-1106347f71aa tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:43.111322 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-34c4f13e-a103-44d8-81bb-1106347f71aa tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:43.240062 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-34c4f13e-a103-44d8-81bb-1106347f71aa tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lazy-loading 'services' on Instance uuid ec13a585-cf06-497f-8381-d90b5531f029 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:20:43.359439 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-34c4f13e-a103-44d8-81bb-1106347f71aa tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029/os-volume_attachments/a3e7577d-578a-43be-b857-e5dbbeaf96dc" status: 202 len: 0 microversion: 2.1 time: 0.260146 May 17 18:20:43.360049 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 239/419] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:20:43 2022] DELETE /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029/os-volume_attachments/a3e7577d-578a-43be-b857-e5dbbeaf96dc => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:20:43.390158 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0d76b2f4-ebdf-49c8-b2a7-30aef1a5e0ef tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:43.393191 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0d76b2f4-ebdf-49c8-b2a7-30aef1a5e0ef tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:43.400758 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0d76b2f4-ebdf-49c8-b2a7-30aef1a5e0ef tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:43.401956 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0d76b2f4-ebdf-49c8-b2a7-30aef1a5e0ef tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:43.403187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0d76b2f4-ebdf-49c8-b2a7-30aef1a5e0ef tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:43.403723 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0d76b2f4-ebdf-49c8-b2a7-30aef1a5e0ef tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:43.751540 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0d76b2f4-ebdf-49c8-b2a7-30aef1a5e0ef tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:43.758761 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0d76b2f4-ebdf-49c8-b2a7-30aef1a5e0ef tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1564 microversion: 2.1 time: 0.373786 May 17 18:20:43.760772 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 181/420] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:43 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1564 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:43.776895 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0826859e-6a0a-452e-bbd2-0d8d6347466c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:43.777489 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0826859e-6a0a-452e-bbd2-0d8d6347466c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:43.783577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0826859e-6a0a-452e-bbd2-0d8d6347466c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:43.784023 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0826859e-6a0a-452e-bbd2-0d8d6347466c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:43.784780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0826859e-6a0a-452e-bbd2-0d8d6347466c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:43.785212 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0826859e-6a0a-452e-bbd2-0d8d6347466c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:43.863345 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0826859e-6a0a-452e-bbd2-0d8d6347466c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091590 May 17 18:20:43.863936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 240/421] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 17 18:20:43 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:20:44.481282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2e45fe9c-d958-44d0-8c47-6a968106a158 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:44.481905 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2e45fe9c-d958-44d0-8c47-6a968106a158 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:44.488072 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2e45fe9c-d958-44d0-8c47-6a968106a158 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:44.488524 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2e45fe9c-d958-44d0-8c47-6a968106a158 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:44.489296 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2e45fe9c-d958-44d0-8c47-6a968106a158 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:44.489758 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2e45fe9c-d958-44d0-8c47-6a968106a158 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:44.516603 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2e45fe9c-d958-44d0-8c47-6a968106a158 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:20:44.601809 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2e45fe9c-d958-44d0-8c47-6a968106a158 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "DELETE /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 204 len: 0 microversion: 2.1 time: 0.124074 May 17 18:20:44.602591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 182/422] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:20:44 2022] DELETE /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:20:44.611680 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8af49fb5-1b0b-4ace-ba15-850d195417e9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:44.612317 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-8af49fb5-1b0b-4ace-ba15-850d195417e9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:44.618685 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8af49fb5-1b0b-4ace-ba15-850d195417e9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:44.619137 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8af49fb5-1b0b-4ace-ba15-850d195417e9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:44.619964 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8af49fb5-1b0b-4ace-ba15-850d195417e9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:44.620400 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8af49fb5-1b0b-4ace-ba15-850d195417e9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:44.827018 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8af49fb5-1b0b-4ace-ba15-850d195417e9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:44.835254 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8af49fb5-1b0b-4ace-ba15-850d195417e9 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1514 microversion: 2.1 time: 0.227676 May 17 18:20:44.836265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 241/423] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:44 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:20:44.914821 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-7c150907-9ca5-4f76-8fa2-956ba94e43e4 req-7274ed99-d45c-4557-bda3-cec868b75129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94d1524-97f8-49d7-8685-184066d438d2", "tag": "08d646aa-87c5-4998-abe8-ddbc4d06f4f0"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:44.923139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-7c150907-9ca5-4f76-8fa2-956ba94e43e4 req-7274ed99-d45c-4557-bda3-cec868b75129 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:44.923591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-7c150907-9ca5-4f76-8fa2-956ba94e43e4 req-7274ed99-d45c-4557-bda3-cec868b75129 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:44.936199 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-7c150907-9ca5-4f76-8fa2-956ba94e43e4 req-7274ed99-d45c-4557-bda3-cec868b75129 service nova] Creating event network-changed:08d646aa-87c5-4998-abe8-ddbc4d06f4f0 for instance b94d1524-97f8-49d7-8685-184066d438d2 on hv-cinder-83736 May 17 18:20:44.941323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-7c150907-9ca5-4f76-8fa2-956ba94e43e4 req-7274ed99-d45c-4557-bda3-cec868b75129 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030389 May 17 18:20:44.941967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 183/424] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:20:45.852714 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d6302052-06f4-4d7b-a603-bdff32a3b5c4 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:45.853446 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d6302052-06f4-4d7b-a603-bdff32a3b5c4 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:45.860700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d6302052-06f4-4d7b-a603-bdff32a3b5c4 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:45.861241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d6302052-06f4-4d7b-a603-bdff32a3b5c4 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:45.862127 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d6302052-06f4-4d7b-a603-bdff32a3b5c4 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:45.862634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d6302052-06f4-4d7b-a603-bdff32a3b5c4 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:46.007442 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d6302052-06f4-4d7b-a603-bdff32a3b5c4 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:46.018356 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d6302052-06f4-4d7b-a603-bdff32a3b5c4 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1514 microversion: 2.1 time: 0.168806 May 17 18:20:46.028447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 242/425] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:45 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1514 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:47.036583 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f1b79ce3-b79f-4c20-b482-027011934d25 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:47.037283 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f1b79ce3-b79f-4c20-b482-027011934d25 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:47.043898 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f1b79ce3-b79f-4c20-b482-027011934d25 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:47.044350 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f1b79ce3-b79f-4c20-b482-027011934d25 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:47.045123 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f1b79ce3-b79f-4c20-b482-027011934d25 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:47.045586 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f1b79ce3-b79f-4c20-b482-027011934d25 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:47.184403 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f1b79ce3-b79f-4c20-b482-027011934d25 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:20:47.195763 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f1b79ce3-b79f-4c20-b482-027011934d25 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 200 len: 1514 microversion: 2.1 time: 0.163455 May 17 18:20:47.196744 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 184/426] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:47 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:20:47.593286 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-43f07272-0461-4ced-8a27-34e52b0f7354 req-66ca20c2-096b-4761-9ab1-5727a38dfcf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec13a585-cf06-497f-8381-d90b5531f029", "name": "network-vif-deleted", "tag": "46b16982-1e63-43c1-a0be-4dfa4d935943"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:47.605336 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-43f07272-0461-4ced-8a27-34e52b0f7354 req-66ca20c2-096b-4761-9ab1-5727a38dfcf0 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:47.608168 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-43f07272-0461-4ced-8a27-34e52b0f7354 req-66ca20c2-096b-4761-9ab1-5727a38dfcf0 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:47.621850 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-43f07272-0461-4ced-8a27-34e52b0f7354 req-66ca20c2-096b-4761-9ab1-5727a38dfcf0 service nova] Creating event network-vif-deleted:46b16982-1e63-43c1-a0be-4dfa4d935943 for instance ec13a585-cf06-497f-8381-d90b5531f029 on hv-cinder-83736 May 17 18:20:47.627752 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-43f07272-0461-4ced-8a27-34e52b0f7354 req-66ca20c2-096b-4761-9ab1-5727a38dfcf0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037987 May 17 18:20:47.628861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 243/427] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:20:48.213404 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-63d56f02-a73b-4ccb-b9ab-031b98803139 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:20:48.214136 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-63d56f02-a73b-4ccb-b9ab-031b98803139 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: ec13a585-cf06-497f-8381-d90b5531f029] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:20:48.220889 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63d56f02-a73b-4ccb-b9ab-031b98803139 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:48.221369 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63d56f02-a73b-4ccb-b9ab-031b98803139 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:48.223202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63d56f02-a73b-4ccb-b9ab-031b98803139 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:20:48.223791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63d56f02-a73b-4ccb-b9ab-031b98803139 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:20:48.238333 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-63d56f02-a73b-4ccb-b9ab-031b98803139 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] HTTP exception thrown: Instance ec13a585-cf06-497f-8381-d90b5531f029 could not be found. May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-63d56f02-a73b-4ccb-b9ab-031b98803139 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Request method failure captured: May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 HTTP/1.1 May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-cNn1Jveh5qtp4LEWZo1iGfdzmv_mDMA1meI1wszB5cXEWTU5vovpkLk9At8v-uV0xzQy2gsRwhT34clA50hziWwCt2XL86SiCQwOlXpUkfYYXenk4r4WyjBp4-wHsWvA16TGzoYHahOrPVoGmRn8Y_8aTPTYaq6Ry2rPCt7b8oXOc May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 80d1667aeb814212abe473f58d0ff420 May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-VolumesSnapshotTestJSON-418095008 May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:20:48.240070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_80d1667aeb814212abe473f58d0ff420"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/80d1667aeb814212abe473f58d0ff420"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/80d1667aeb814212abe473f58d0ff420"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/80d1667aeb814212abe473f58d0ff420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-VolumesSnapshotTestJSON-418095008 May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 80d1667aeb814212abe473f58d0ff420 May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-418095008 May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-VolumesSnapshotTestJSON-418095008-project May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 8dc55bbbc4a544909a8c80d9638c3ea6 May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-VolumesSnapshotTestJSON-418095008-project May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance ec13a585-cf06-497f-8381-d90b5531f029 could not be found. May 17 18:20:48.241609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': 'ec13a585-cf06-497f-8381-d90b5531f029'} May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec13a585-cf06-497f-8381-d90b5531f029 could not be found. May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:20:48.242423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec13a585-cf06-497f-8381-d90b5531f029 could not be found. May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec13a585-cf06-497f-8381-d90b5531f029 could not be found. May 17 18:20:48.247779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:20:48.249585 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-63d56f02-a73b-4ccb-b9ab-031b98803139 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Returning 404 to user: Instance ec13a585-cf06-497f-8381-d90b5531f029 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:20:48.249585 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-63d56f02-a73b-4ccb-b9ab-031b98803139 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029" status: 404 len: 111 microversion: 2.1 time: 0.032943 May 17 18:20:48.249585 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 185/428] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:20:48 2022] GET /compute/v2.1/servers/ec13a585-cf06-497f-8381-d90b5531f029 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:20:56.893087 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-780afc01-55f5-4aec-a240-d8a1b9c94515 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Action: 'create', calling method: .version_select at 0x7f4e5b4ff8b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-63217234", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNFVP+5HDk4blRPOmJTXlNbVr6ojvdWdR1IGUdQlm3L1dmItUN7l2QRbdaOM2jWHvA6t/5PGwhi0rG8Pyuqj47HPI10fK3myR5eZ+R3AKHVPAm4zrW9P90fNQvlLAYIhqQ=="}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:20:56.907996 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-780afc01-55f5-4aec-a240-d8a1b9c94515 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Getting quotas for project 481c26193c6141588dd15fd5c593de86. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:20:56.911811 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-780afc01-55f5-4aec-a240-d8a1b9c94515 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Getting quotas for user 861ad9a7c63a4d66a1806c4576cddce5 and project 481c26193c6141588dd15fd5c593de86. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:20:56.935283 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-780afc01-55f5-4aec-a240-d8a1b9c94515 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.249676 May 17 18:20:56.935886 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 244/429] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 17 18:20:56 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:04.948224 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:21:04.949157 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Tue May 17 18:21:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:21:05.658935 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-930226842", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "networks": [{"uuid": "4a6a683b-83c8-4aab-94d5-fc0e51543f48"}]}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:05.708834 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] validate_networks() for [('4a6a683b-83c8-4aab-94d5-fc0e51543f48', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:21:06.285685 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:21:06.286244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:21:06.286613 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:21:06.287030 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:21:06.287458 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:21:06.296866 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:06.297327 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:06.298260 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:06.298708 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:06.315967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Getting quotas for project 80d1667aeb814212abe473f58d0ff420. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:21:06.320048 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Getting quotas for user 8dc55bbbc4a544909a8c80d9638c3ea6 and project 80d1667aeb814212abe473f58d0ff420. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:21:06.333880 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:21:06.336189 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:21:06.386623 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c075828a-976d-4777-a8cf-89b652e06079 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.731872 May 17 18:21:06.387251 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 186/430] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:21:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:21:06.399345 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fcf114fe-f074-4b3b-a386-f548a79793ed tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:06.399754 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fcf114fe-f074-4b3b-a386-f548a79793ed tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:06.459827 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fcf114fe-f074-4b3b-a386-f548a79793ed tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:06.467090 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fcf114fe-f074-4b3b-a386-f548a79793ed tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1218 microversion: 2.1 time: 0.073462 May 17 18:21:06.467648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 245/431] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:06 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:07.484985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-fe9deacb-3b00-4c98-bed2-8d97836976dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:07.486199 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-fe9deacb-3b00-4c98-bed2-8d97836976dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:07.493449 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fe9deacb-3b00-4c98-bed2-8d97836976dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:07.495039 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fe9deacb-3b00-4c98-bed2-8d97836976dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:07.496036 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fe9deacb-3b00-4c98-bed2-8d97836976dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:07.496732 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fe9deacb-3b00-4c98-bed2-8d97836976dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:07.583041 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-fe9deacb-3b00-4c98-bed2-8d97836976dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:07.590974 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-fe9deacb-3b00-4c98-bed2-8d97836976dc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1276 microversion: 2.1 time: 0.110142 May 17 18:21:07.591672 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 187/432] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:07 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1276 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:08.609070 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3cd7df36-acf6-4b07-b3a8-bf2c6f23a4db tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:08.609767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3cd7df36-acf6-4b07-b3a8-bf2c6f23a4db tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:08.616201 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3cd7df36-acf6-4b07-b3a8-bf2c6f23a4db tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:08.616652 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3cd7df36-acf6-4b07-b3a8-bf2c6f23a4db tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:08.617422 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3cd7df36-acf6-4b07-b3a8-bf2c6f23a4db tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:08.617887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3cd7df36-acf6-4b07-b3a8-bf2c6f23a4db tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:08.631801 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-50589ae2-b8db-47a4-9f0f-261e2a171cee req-68026f2f-56d3-49e1-b21b-f530f4982959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d7e9281-594b-413f-950a-9c225b3ff0ae", "tag": "60f7f7c7-fbae-40cb-9c19-1eee4b18171b"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:08.640804 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-50589ae2-b8db-47a4-9f0f-261e2a171cee req-68026f2f-56d3-49e1-b21b-f530f4982959 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:08.653380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-50589ae2-b8db-47a4-9f0f-261e2a171cee req-68026f2f-56d3-49e1-b21b-f530f4982959 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:08.672001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-50589ae2-b8db-47a4-9f0f-261e2a171cee req-68026f2f-56d3-49e1-b21b-f530f4982959 service nova] Creating event network-changed:60f7f7c7-fbae-40cb-9c19-1eee4b18171b for instance 8d7e9281-594b-413f-950a-9c225b3ff0ae on hv-cinder-83736 May 17 18:21:08.679531 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-50589ae2-b8db-47a4-9f0f-261e2a171cee req-68026f2f-56d3-49e1-b21b-f530f4982959 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051350 May 17 18:21:08.680125 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 188/433] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:08.772572 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3cd7df36-acf6-4b07-b3a8-bf2c6f23a4db tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:08.780379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3cd7df36-acf6-4b07-b3a8-bf2c6f23a4db tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1318 microversion: 2.1 time: 0.176133 May 17 18:21:08.780937 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 246/434] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:08 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:09.797309 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5e4dabfb-0965-4787-b226-d53893e2238a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:09.798254 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5e4dabfb-0965-4787-b226-d53893e2238a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:09.804723 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5e4dabfb-0965-4787-b226-d53893e2238a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:09.805477 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5e4dabfb-0965-4787-b226-d53893e2238a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:09.806264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5e4dabfb-0965-4787-b226-d53893e2238a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:09.806700 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5e4dabfb-0965-4787-b226-d53893e2238a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:09.949437 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5e4dabfb-0965-4787-b226-d53893e2238a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:09.956857 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5e4dabfb-0965-4787-b226-d53893e2238a tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1318 microversion: 2.1 time: 0.163813 May 17 18:21:09.957422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 189/435] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:09 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:10.973840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-56b96c6f-a2c2-4c31-8c9c-886a6b4ccf2f tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:10.974445 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-56b96c6f-a2c2-4c31-8c9c-886a6b4ccf2f tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:10.980789 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-56b96c6f-a2c2-4c31-8c9c-886a6b4ccf2f tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:10.981345 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-56b96c6f-a2c2-4c31-8c9c-886a6b4ccf2f tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:10.982201 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-56b96c6f-a2c2-4c31-8c9c-886a6b4ccf2f tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:10.982743 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-56b96c6f-a2c2-4c31-8c9c-886a6b4ccf2f tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:11.115483 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-56b96c6f-a2c2-4c31-8c9c-886a6b4ccf2f tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:11.123149 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-56b96c6f-a2c2-4c31-8c9c-886a6b4ccf2f tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1318 microversion: 2.1 time: 0.153162 May 17 18:21:11.123702 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 247/436] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:10 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:12.140310 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-58fd3262-1b9b-413d-8c1c-68fbadcdee3b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:12.140930 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-58fd3262-1b9b-413d-8c1c-68fbadcdee3b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:12.147291 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-58fd3262-1b9b-413d-8c1c-68fbadcdee3b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:12.147747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-58fd3262-1b9b-413d-8c1c-68fbadcdee3b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:12.148516 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-58fd3262-1b9b-413d-8c1c-68fbadcdee3b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:12.148965 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-58fd3262-1b9b-413d-8c1c-68fbadcdee3b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:12.279124 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-58fd3262-1b9b-413d-8c1c-68fbadcdee3b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:12.286406 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-58fd3262-1b9b-413d-8c1c-68fbadcdee3b tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1318 microversion: 2.1 time: 0.149932 May 17 18:21:12.286965 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 190/437] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:12 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:13.304001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cd6d3bc1-2943-4262-98d2-2888315fdb27 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:13.305022 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cd6d3bc1-2943-4262-98d2-2888315fdb27 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:13.312627 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd6d3bc1-2943-4262-98d2-2888315fdb27 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:13.312909 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd6d3bc1-2943-4262-98d2-2888315fdb27 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:13.313717 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd6d3bc1-2943-4262-98d2-2888315fdb27 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:13.314153 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd6d3bc1-2943-4262-98d2-2888315fdb27 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:13.445925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cd6d3bc1-2943-4262-98d2-2888315fdb27 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:13.453418 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cd6d3bc1-2943-4262-98d2-2888315fdb27 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1318 microversion: 2.1 time: 0.153931 May 17 18:21:13.454007 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 248/438] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:13 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:14.470448 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e7910a1f-426f-4f84-a4f8-71fbbf13c4cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:14.471073 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e7910a1f-426f-4f84-a4f8-71fbbf13c4cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:14.477388 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e7910a1f-426f-4f84-a4f8-71fbbf13c4cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:14.477881 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e7910a1f-426f-4f84-a4f8-71fbbf13c4cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:14.478655 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e7910a1f-426f-4f84-a4f8-71fbbf13c4cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:14.479102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e7910a1f-426f-4f84-a4f8-71fbbf13c4cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:14.608078 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e7910a1f-426f-4f84-a4f8-71fbbf13c4cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:14.615402 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e7910a1f-426f-4f84-a4f8-71fbbf13c4cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1318 microversion: 2.1 time: 0.148770 May 17 18:21:14.616040 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 191/439] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:14 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:21:15.632387 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b1bf6f78-9d85-424c-9db6-de5dc6a3997d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:15.632998 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b1bf6f78-9d85-424c-9db6-de5dc6a3997d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:15.639298 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b1bf6f78-9d85-424c-9db6-de5dc6a3997d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:15.639745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b1bf6f78-9d85-424c-9db6-de5dc6a3997d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:15.640500 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b1bf6f78-9d85-424c-9db6-de5dc6a3997d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:15.640935 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b1bf6f78-9d85-424c-9db6-de5dc6a3997d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:15.766845 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b1bf6f78-9d85-424c-9db6-de5dc6a3997d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:15.774007 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b1bf6f78-9d85-424c-9db6-de5dc6a3997d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1318 microversion: 2.1 time: 0.145442 May 17 18:21:15.774567 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 249/440] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:15 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:16.743719 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-f5c3f8c7-389e-410b-ba12-473b58211dc3 req-abb8f02f-4f8a-43b8-b256-d136678a8310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7e9281-594b-413f-950a-9c225b3ff0ae", "name": "network-vif-plugged", "status": "completed", "tag": "60f7f7c7-fbae-40cb-9c19-1eee4b18171b"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:16.753085 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f5c3f8c7-389e-410b-ba12-473b58211dc3 req-abb8f02f-4f8a-43b8-b256-d136678a8310 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:16.753734 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f5c3f8c7-389e-410b-ba12-473b58211dc3 req-abb8f02f-4f8a-43b8-b256-d136678a8310 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:16.767491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-f5c3f8c7-389e-410b-ba12-473b58211dc3 req-abb8f02f-4f8a-43b8-b256-d136678a8310 service nova] Creating event network-vif-plugged:60f7f7c7-fbae-40cb-9c19-1eee4b18171b for instance 8d7e9281-594b-413f-950a-9c225b3ff0ae on hv-cinder-83736 May 17 18:21:16.774982 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-f5c3f8c7-389e-410b-ba12-473b58211dc3 req-abb8f02f-4f8a-43b8-b256-d136678a8310 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034861 May 17 18:21:16.775853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 192/441] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:16.791307 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cf434ecb-3b41-4908-8d67-313fd192f65e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:16.792448 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cf434ecb-3b41-4908-8d67-313fd192f65e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:16.799518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf434ecb-3b41-4908-8d67-313fd192f65e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:16.799966 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf434ecb-3b41-4908-8d67-313fd192f65e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:16.800739 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf434ecb-3b41-4908-8d67-313fd192f65e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:16.801171 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf434ecb-3b41-4908-8d67-313fd192f65e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:16.938292 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cf434ecb-3b41-4908-8d67-313fd192f65e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:16.945725 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cf434ecb-3b41-4908-8d67-313fd192f65e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1318 microversion: 2.1 time: 0.158177 May 17 18:21:16.946291 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 250/442] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:16 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:17.964249 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-434c38c5-fc02-4f05-b5a9-e5d155d11710 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:17.965316 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-434c38c5-fc02-4f05-b5a9-e5d155d11710 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:17.971417 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-434c38c5-fc02-4f05-b5a9-e5d155d11710 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:17.971875 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-434c38c5-fc02-4f05-b5a9-e5d155d11710 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:17.972649 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-434c38c5-fc02-4f05-b5a9-e5d155d11710 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:17.973072 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-434c38c5-fc02-4f05-b5a9-e5d155d11710 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:18.099800 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-434c38c5-fc02-4f05-b5a9-e5d155d11710 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:18.107010 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-434c38c5-fc02-4f05-b5a9-e5d155d11710 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1318 microversion: 2.1 time: 0.147889 May 17 18:21:18.107566 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 193/443] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:17 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:19.122790 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1080de7e-c90a-4bb7-9d69-5e685470f7a6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:19.123310 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1080de7e-c90a-4bb7-9d69-5e685470f7a6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:19.129633 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1080de7e-c90a-4bb7-9d69-5e685470f7a6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:19.130084 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1080de7e-c90a-4bb7-9d69-5e685470f7a6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:19.130849 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1080de7e-c90a-4bb7-9d69-5e685470f7a6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:19.131287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1080de7e-c90a-4bb7-9d69-5e685470f7a6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:19.258353 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1080de7e-c90a-4bb7-9d69-5e685470f7a6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:19.265910 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1080de7e-c90a-4bb7-9d69-5e685470f7a6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1318 microversion: 2.1 time: 0.147024 May 17 18:21:19.266622 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 251/444] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:19 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:20.282438 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0b31bec9-1834-4960-9b32-262eccc1c2f6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:20.283053 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0b31bec9-1834-4960-9b32-262eccc1c2f6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:20.289281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0b31bec9-1834-4960-9b32-262eccc1c2f6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:20.289759 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0b31bec9-1834-4960-9b32-262eccc1c2f6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:20.290522 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0b31bec9-1834-4960-9b32-262eccc1c2f6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:20.290964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0b31bec9-1834-4960-9b32-262eccc1c2f6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:20.419014 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0b31bec9-1834-4960-9b32-262eccc1c2f6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:20.426242 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0b31bec9-1834-4960-9b32-262eccc1c2f6 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1507 microversion: 2.1 time: 0.147524 May 17 18:21:20.426829 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 194/445] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:20 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:20.443293 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0d1d6945-4e2a-42c0-803f-4ee8bca300bf tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78d19824-e04f-4cbf-96a2-4e00346a0aa9", "device": "/dev/sdb"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:20.444442 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0d1d6945-4e2a-42c0-803f-4ee8bca300bf tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:20.451591 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0d1d6945-4e2a-42c0-803f-4ee8bca300bf tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:20.452036 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0d1d6945-4e2a-42c0-803f-4ee8bca300bf tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:20.452815 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0d1d6945-4e2a-42c0-803f-4ee8bca300bf tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:20.453247 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0d1d6945-4e2a-42c0-803f-4ee8bca300bf tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:20.677502 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0d1d6945-4e2a-42c0-803f-4ee8bca300bf tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "POST /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.237973 May 17 18:21:20.678297 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 252/446] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:21:20 2022] POST /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae/os-volume_attachments => generated 194 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:28.843032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-405980313", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63217234", "security_groups": [{"name": "tempest-secgroup-smoke-1126375773"}], "block_device_mapping_v2": [{"uuid": "25aba8ef-5fd6-4232-90b2-5df33578891a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "38c10630-122b-4079-98b2-93ad2511bb9a"}]}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:28.951358 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] validate_networks() for [('38c10630-122b-4079-98b2-93ad2511bb9a', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:21:29.318914 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:21:29.319462 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:21:29.320027 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:21:29.320483 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:21:29.320973 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:21:29.331939 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:29.332388 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:29.333194 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:29.333671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:29.349752 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Getting quotas for project 481c26193c6141588dd15fd5c593de86. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:21:29.354063 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Getting quotas for user 861ad9a7c63a4d66a1806c4576cddce5 and project 481c26193c6141588dd15fd5c593de86. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:21:29.411405 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:21:29.413845 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25aba8ef-5fd6-4232-90b2-5df33578891a',volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:21:29.540920 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-337d2c70-c1d8-40ef-9b86-70fc90af0c8f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.701841 May 17 18:21:29.542198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 195/447] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:21:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:21:29.554122 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e0dcb3a7-b62c-496c-a13e-d6443393836e tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:29.554819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e0dcb3a7-b62c-496c-a13e-d6443393836e tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:29.614457 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e0dcb3a7-b62c-496c-a13e-d6443393836e tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:29.621054 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e0dcb3a7-b62c-496c-a13e-d6443393836e tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1092 microversion: 2.1 time: 0.072501 May 17 18:21:29.621731 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 253/448] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:29 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1092 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:30.643100 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a95e3acc-61bf-4b15-8738-1b374e6687d8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:30.643722 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a95e3acc-61bf-4b15-8738-1b374e6687d8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:30.649961 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a95e3acc-61bf-4b15-8738-1b374e6687d8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:30.651039 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a95e3acc-61bf-4b15-8738-1b374e6687d8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:30.651816 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a95e3acc-61bf-4b15-8738-1b374e6687d8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:30.652259 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a95e3acc-61bf-4b15-8738-1b374e6687d8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:30.715500 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a95e3acc-61bf-4b15-8738-1b374e6687d8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:30.722822 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a95e3acc-61bf-4b15-8738-1b374e6687d8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1142 microversion: 2.1 time: 0.088313 May 17 18:21:30.723378 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 196/449] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:30 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1142 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:31.739441 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-90de9599-8c82-457f-8510-9a73e3054f40 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:31.740054 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-90de9599-8c82-457f-8510-9a73e3054f40 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:31.747734 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90de9599-8c82-457f-8510-9a73e3054f40 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:31.748190 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90de9599-8c82-457f-8510-9a73e3054f40 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:31.748949 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90de9599-8c82-457f-8510-9a73e3054f40 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:31.749392 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90de9599-8c82-457f-8510-9a73e3054f40 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:31.808357 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-90de9599-8c82-457f-8510-9a73e3054f40 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:31.815922 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-90de9599-8c82-457f-8510-9a73e3054f40 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1134 microversion: 2.1 time: 0.080349 May 17 18:21:31.816476 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 254/450] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:31 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1134 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:32.833006 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-18ce43c4-04bb-4526-8b39-c781fb546b32 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:32.833653 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-18ce43c4-04bb-4526-8b39-c781fb546b32 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:32.840723 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-18ce43c4-04bb-4526-8b39-c781fb546b32 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:32.841179 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-18ce43c4-04bb-4526-8b39-c781fb546b32 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:32.841980 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-18ce43c4-04bb-4526-8b39-c781fb546b32 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:32.842425 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-18ce43c4-04bb-4526-8b39-c781fb546b32 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:32.905391 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-18ce43c4-04bb-4526-8b39-c781fb546b32 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:32.912663 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-18ce43c4-04bb-4526-8b39-c781fb546b32 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1134 microversion: 2.1 time: 0.083555 May 17 18:21:32.913684 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 197/451] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:32 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1134 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:33.929781 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6e32fcb2-2408-4e3d-99a9-507beb56c3be tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:33.930403 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6e32fcb2-2408-4e3d-99a9-507beb56c3be tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:33.938196 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6e32fcb2-2408-4e3d-99a9-507beb56c3be tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:33.938670 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6e32fcb2-2408-4e3d-99a9-507beb56c3be tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:33.939527 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6e32fcb2-2408-4e3d-99a9-507beb56c3be tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:33.940006 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6e32fcb2-2408-4e3d-99a9-507beb56c3be tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:34.006951 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6e32fcb2-2408-4e3d-99a9-507beb56c3be tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:34.015301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6e32fcb2-2408-4e3d-99a9-507beb56c3be tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1208 microversion: 2.1 time: 0.089530 May 17 18:21:34.015879 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 255/452] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:33 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1208 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:35.032365 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ee7f3840-1c43-4628-ad59-27bf3913fc3f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:35.034429 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ee7f3840-1c43-4628-ad59-27bf3913fc3f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:35.041854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ee7f3840-1c43-4628-ad59-27bf3913fc3f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:35.042678 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ee7f3840-1c43-4628-ad59-27bf3913fc3f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:35.043531 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ee7f3840-1c43-4628-ad59-27bf3913fc3f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:35.044040 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ee7f3840-1c43-4628-ad59-27bf3913fc3f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:35.189765 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ee7f3840-1c43-4628-ad59-27bf3913fc3f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:35.191548 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-f71b6469-b9c0-4af9-9755-a0c5adea8a43 req-2ea8903e-0343-491d-ba63-abe269cdbbdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef769ce-3ca7-4bbd-84dd-567ed0af61b9", "tag": "14f3ea7b-33ca-4752-b87b-d34d49e5b90c"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:35.199473 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ee7f3840-1c43-4628-ad59-27bf3913fc3f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.170606 May 17 18:21:35.200370 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 198/453] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:35 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:35.202752 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-f71b6469-b9c0-4af9-9755-a0c5adea8a43 req-2ea8903e-0343-491d-ba63-abe269cdbbdf service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:35.203142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-f71b6469-b9c0-4af9-9755-a0c5adea8a43 req-2ea8903e-0343-491d-ba63-abe269cdbbdf service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:35.219767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-f71b6469-b9c0-4af9-9755-a0c5adea8a43 req-2ea8903e-0343-491d-ba63-abe269cdbbdf service nova] Creating event network-changed:14f3ea7b-33ca-4752-b87b-d34d49e5b90c for instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 on hv-cinder-83736 May 17 18:21:35.227541 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-f71b6469-b9c0-4af9-9755-a0c5adea8a43 req-2ea8903e-0343-491d-ba63-abe269cdbbdf service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039555 May 17 18:21:35.227541 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 256/454] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:36.216758 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-32a6529c-ec0a-41c6-b75d-2ea17d553cef tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:36.217381 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-32a6529c-ec0a-41c6-b75d-2ea17d553cef tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:36.223845 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32a6529c-ec0a-41c6-b75d-2ea17d553cef tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:36.224298 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32a6529c-ec0a-41c6-b75d-2ea17d553cef tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:36.225064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32a6529c-ec0a-41c6-b75d-2ea17d553cef tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:36.225530 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32a6529c-ec0a-41c6-b75d-2ea17d553cef tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:36.355571 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-32a6529c-ec0a-41c6-b75d-2ea17d553cef tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:36.363099 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-32a6529c-ec0a-41c6-b75d-2ea17d553cef tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.150862 May 17 18:21:36.363654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 199/455] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:36 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:37.381289 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-15e968f6-19ee-477b-af0d-e6232fe0ff78 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:37.382184 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-15e968f6-19ee-477b-af0d-e6232fe0ff78 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:37.388453 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-15e968f6-19ee-477b-af0d-e6232fe0ff78 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:37.388902 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-15e968f6-19ee-477b-af0d-e6232fe0ff78 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:37.389708 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-15e968f6-19ee-477b-af0d-e6232fe0ff78 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:37.390152 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-15e968f6-19ee-477b-af0d-e6232fe0ff78 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:37.524007 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-15e968f6-19ee-477b-af0d-e6232fe0ff78 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:37.532021 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-15e968f6-19ee-477b-af0d-e6232fe0ff78 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.155392 May 17 18:21:37.532585 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 257/456] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:37 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:38.548850 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5c108de2-2903-44c7-9336-fa7e02af9354 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:38.549494 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5c108de2-2903-44c7-9336-fa7e02af9354 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:38.555860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5c108de2-2903-44c7-9336-fa7e02af9354 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:38.556333 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5c108de2-2903-44c7-9336-fa7e02af9354 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:38.557108 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5c108de2-2903-44c7-9336-fa7e02af9354 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:38.557590 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5c108de2-2903-44c7-9336-fa7e02af9354 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:38.688475 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5c108de2-2903-44c7-9336-fa7e02af9354 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:38.695771 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5c108de2-2903-44c7-9336-fa7e02af9354 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.150773 May 17 18:21:38.696362 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 200/457] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:38 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:21:39.715753 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-59e6025d-4a72-4713-8992-ca445bd628ea tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:39.716376 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-59e6025d-4a72-4713-8992-ca445bd628ea tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:39.722833 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-59e6025d-4a72-4713-8992-ca445bd628ea tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:39.723239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-59e6025d-4a72-4713-8992-ca445bd628ea tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:39.724010 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-59e6025d-4a72-4713-8992-ca445bd628ea tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:39.724448 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-59e6025d-4a72-4713-8992-ca445bd628ea tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:39.859298 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-59e6025d-4a72-4713-8992-ca445bd628ea tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:39.866992 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-59e6025d-4a72-4713-8992-ca445bd628ea tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.155625 May 17 18:21:39.867586 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 258/458] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:39 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:40.888486 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7c71ca10-65f0-4011-9f05-1d8956aa2661 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:40.889102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7c71ca10-65f0-4011-9f05-1d8956aa2661 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:40.895504 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7c71ca10-65f0-4011-9f05-1d8956aa2661 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:40.895961 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7c71ca10-65f0-4011-9f05-1d8956aa2661 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:40.896726 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7c71ca10-65f0-4011-9f05-1d8956aa2661 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:40.897165 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7c71ca10-65f0-4011-9f05-1d8956aa2661 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:41.027678 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7c71ca10-65f0-4011-9f05-1d8956aa2661 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:41.034936 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7c71ca10-65f0-4011-9f05-1d8956aa2661 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.150764 May 17 18:21:41.035619 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 201/459] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:40 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:42.051932 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c119b99e-7038-4ec2-9234-b4c35f3fa90b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:42.052547 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c119b99e-7038-4ec2-9234-b4c35f3fa90b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:42.059366 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c119b99e-7038-4ec2-9234-b4c35f3fa90b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:42.059820 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c119b99e-7038-4ec2-9234-b4c35f3fa90b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:42.060587 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c119b99e-7038-4ec2-9234-b4c35f3fa90b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:42.061025 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c119b99e-7038-4ec2-9234-b4c35f3fa90b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:42.190692 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c119b99e-7038-4ec2-9234-b4c35f3fa90b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:42.199483 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c119b99e-7038-4ec2-9234-b4c35f3fa90b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.151128 May 17 18:21:42.200042 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 259/460] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:42 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:43.215890 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-03ae4563-66fd-40e9-99be-264630f10978 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:43.216512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-03ae4563-66fd-40e9-99be-264630f10978 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:43.222824 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-03ae4563-66fd-40e9-99be-264630f10978 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:43.223281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-03ae4563-66fd-40e9-99be-264630f10978 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:43.224059 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-03ae4563-66fd-40e9-99be-264630f10978 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:43.224504 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-03ae4563-66fd-40e9-99be-264630f10978 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:43.359023 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-03ae4563-66fd-40e9-99be-264630f10978 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:43.366360 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-03ae4563-66fd-40e9-99be-264630f10978 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.154272 May 17 18:21:43.366957 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 202/461] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:43 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:44.101874 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1bf71d68-97e0-46f0-953f-4f917446141d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:44.102386 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1bf71d68-97e0-46f0-953f-4f917446141d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:44.109188 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1bf71d68-97e0-46f0-953f-4f917446141d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:44.109691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1bf71d68-97e0-46f0-953f-4f917446141d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:44.110468 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1bf71d68-97e0-46f0-953f-4f917446141d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:44.110924 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1bf71d68-97e0-46f0-953f-4f917446141d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:44.190100 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-1bf71d68-97e0-46f0-953f-4f917446141d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lazy-loading 'services' on Instance uuid 8d7e9281-594b-413f-950a-9c225b3ff0ae {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:21:44.260720 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1bf71d68-97e0-46f0-953f-4f917446141d tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae/os-volume_attachments/78d19824-e04f-4cbf-96a2-4e00346a0aa9" status: 202 len: 0 microversion: 2.1 time: 0.162624 May 17 18:21:44.261303 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 260/462] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:21:44 2022] DELETE /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae/os-volume_attachments/78d19824-e04f-4cbf-96a2-4e00346a0aa9 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:21:44.383503 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e3df691a-b192-4a5a-90c3-6e25b8a365a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:44.384124 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e3df691a-b192-4a5a-90c3-6e25b8a365a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:44.390514 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3df691a-b192-4a5a-90c3-6e25b8a365a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:44.390968 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3df691a-b192-4a5a-90c3-6e25b8a365a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:44.391738 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3df691a-b192-4a5a-90c3-6e25b8a365a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:44.392179 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3df691a-b192-4a5a-90c3-6e25b8a365a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:44.519196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e3df691a-b192-4a5a-90c3-6e25b8a365a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:44.526950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e3df691a-b192-4a5a-90c3-6e25b8a365a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.147296 May 17 18:21:44.527512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 203/463] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:44 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:45.369276 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9fbc903b-339f-4424-8950-d08f7227fb5e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:45.370017 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9fbc903b-339f-4424-8950-d08f7227fb5e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:45.376213 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9fbc903b-339f-4424-8950-d08f7227fb5e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:45.376665 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9fbc903b-339f-4424-8950-d08f7227fb5e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:45.377430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9fbc903b-339f-4424-8950-d08f7227fb5e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:45.377891 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9fbc903b-339f-4424-8950-d08f7227fb5e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:45.402787 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9fbc903b-339f-4424-8950-d08f7227fb5e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Going to try to terminate instance {{(pid=117098) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:21:45.475454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9fbc903b-339f-4424-8950-d08f7227fb5e tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 204 len: 0 microversion: 2.1 time: 0.110666 May 17 18:21:45.476293 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 261/464] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:21:45 2022] DELETE /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:21:45.485427 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ce45d71d-14eb-4922-baad-ccaf82bc5c95 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:45.486279 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ce45d71d-14eb-4922-baad-ccaf82bc5c95 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:45.492502 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ce45d71d-14eb-4922-baad-ccaf82bc5c95 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:45.492958 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ce45d71d-14eb-4922-baad-ccaf82bc5c95 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:45.493759 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ce45d71d-14eb-4922-baad-ccaf82bc5c95 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:45.494203 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ce45d71d-14eb-4922-baad-ccaf82bc5c95 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:45.543986 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-43ed6a35-2072-4e35-87a9-a47082f3a6c5 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:45.544697 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-43ed6a35-2072-4e35-87a9-a47082f3a6c5 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:45.550638 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-43ed6a35-2072-4e35-87a9-a47082f3a6c5 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:45.551098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-43ed6a35-2072-4e35-87a9-a47082f3a6c5 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:45.551874 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-43ed6a35-2072-4e35-87a9-a47082f3a6c5 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:45.552319 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-43ed6a35-2072-4e35-87a9-a47082f3a6c5 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:45.661095 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ce45d71d-14eb-4922-baad-ccaf82bc5c95 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:45.668649 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ce45d71d-14eb-4922-baad-ccaf82bc5c95 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1513 microversion: 2.1 time: 0.188210 May 17 18:21:45.669213 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 204/465] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:45 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1513 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:45.705897 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-43ed6a35-2072-4e35-87a9-a47082f3a6c5 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:45.714432 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-43ed6a35-2072-4e35-87a9-a47082f3a6c5 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.174637 May 17 18:21:45.715024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 262/466] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:45 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:21:46.685560 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5268d159-f9b7-4eaf-b8fa-d8ccb4aa41f3 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:46.686179 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5268d159-f9b7-4eaf-b8fa-d8ccb4aa41f3 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:46.692570 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5268d159-f9b7-4eaf-b8fa-d8ccb4aa41f3 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:46.693026 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5268d159-f9b7-4eaf-b8fa-d8ccb4aa41f3 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:46.694481 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5268d159-f9b7-4eaf-b8fa-d8ccb4aa41f3 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:46.694932 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5268d159-f9b7-4eaf-b8fa-d8ccb4aa41f3 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:46.732747 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a842487a-4848-48b4-b863-53a80a29ee84 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:46.733681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a842487a-4848-48b4-b863-53a80a29ee84 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:46.740207 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a842487a-4848-48b4-b863-53a80a29ee84 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:46.740651 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a842487a-4848-48b4-b863-53a80a29ee84 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:46.741422 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a842487a-4848-48b4-b863-53a80a29ee84 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:46.741884 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a842487a-4848-48b4-b863-53a80a29ee84 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:46.872660 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5268d159-f9b7-4eaf-b8fa-d8ccb4aa41f3 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:46.879954 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5268d159-f9b7-4eaf-b8fa-d8ccb4aa41f3 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1513 microversion: 2.1 time: 0.198402 May 17 18:21:46.880520 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 205/467] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:46 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1513 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:46.903540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a842487a-4848-48b4-b863-53a80a29ee84 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:46.911061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a842487a-4848-48b4-b863-53a80a29ee84 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.183828 May 17 18:21:46.911578 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 263/468] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:46 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:21:47.897731 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-674c469d-4d23-4e66-8eb9-5eed40eae1cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:47.898351 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-674c469d-4d23-4e66-8eb9-5eed40eae1cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:47.904701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-674c469d-4d23-4e66-8eb9-5eed40eae1cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:47.905153 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-674c469d-4d23-4e66-8eb9-5eed40eae1cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:47.905954 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-674c469d-4d23-4e66-8eb9-5eed40eae1cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:47.906397 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-674c469d-4d23-4e66-8eb9-5eed40eae1cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:47.926556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-55cda5b1-2f50-48ea-909c-0322a506a5b7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:47.927172 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-55cda5b1-2f50-48ea-909c-0322a506a5b7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:47.934239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-55cda5b1-2f50-48ea-909c-0322a506a5b7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:47.934691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-55cda5b1-2f50-48ea-909c-0322a506a5b7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:47.935454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-55cda5b1-2f50-48ea-909c-0322a506a5b7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:47.935890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-55cda5b1-2f50-48ea-909c-0322a506a5b7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:48.099092 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-674c469d-4d23-4e66-8eb9-5eed40eae1cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:48.104113 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-55cda5b1-2f50-48ea-909c-0322a506a5b7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:48.107003 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-674c469d-4d23-4e66-8eb9-5eed40eae1cc tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1513 microversion: 2.1 time: 0.213142 May 17 18:21:48.107580 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 206/469] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:47 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:48.111333 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-55cda5b1-2f50-48ea-909c-0322a506a5b7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.188625 May 17 18:21:48.112100 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 264/470] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:47 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:21:49.123443 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6f816adb-1fc1-4147-b032-0370c16cfc91 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:49.123980 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6f816adb-1fc1-4147-b032-0370c16cfc91 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:49.127921 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7e8eb9d7-46f7-4d41-b6d6-9d945dc25c95 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:49.128625 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7e8eb9d7-46f7-4d41-b6d6-9d945dc25c95 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:49.131088 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6f816adb-1fc1-4147-b032-0370c16cfc91 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:49.131534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6f816adb-1fc1-4147-b032-0370c16cfc91 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:49.132302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6f816adb-1fc1-4147-b032-0370c16cfc91 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:49.132739 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6f816adb-1fc1-4147-b032-0370c16cfc91 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:49.135760 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7e8eb9d7-46f7-4d41-b6d6-9d945dc25c95 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:49.136223 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7e8eb9d7-46f7-4d41-b6d6-9d945dc25c95 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:49.137013 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7e8eb9d7-46f7-4d41-b6d6-9d945dc25c95 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:49.137494 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7e8eb9d7-46f7-4d41-b6d6-9d945dc25c95 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:49.349148 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6f816adb-1fc1-4147-b032-0370c16cfc91 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8dc55bbbc4a544909a8c80d9638c3ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80d1667aeb814212abe473f58d0ff420', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:49.352756 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7e8eb9d7-46f7-4d41-b6d6-9d945dc25c95 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:49.360391 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6f816adb-1fc1-4147-b032-0370c16cfc91 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 200 len: 1513 microversion: 2.1 time: 0.240769 May 17 18:21:49.360977 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 207/471] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:49 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:49.361287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7e8eb9d7-46f7-4d41-b6d6-9d945dc25c95 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.236826 May 17 18:21:49.362021 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 265/472] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:49 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:49.365416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-0cc284ae-7ab5-4341-b9c0-e7379a60c4e5 req-d3e28a40-598e-4919-8241-09adef688f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d7e9281-594b-413f-950a-9c225b3ff0ae", "name": "network-vif-deleted", "tag": "60f7f7c7-fbae-40cb-9c19-1eee4b18171b"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:49.375786 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-0cc284ae-7ab5-4341-b9c0-e7379a60c4e5 req-d3e28a40-598e-4919-8241-09adef688f99 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:49.376244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-0cc284ae-7ab5-4341-b9c0-e7379a60c4e5 req-d3e28a40-598e-4919-8241-09adef688f99 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:49.388741 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-0cc284ae-7ab5-4341-b9c0-e7379a60c4e5 req-d3e28a40-598e-4919-8241-09adef688f99 service nova] Creating event network-vif-deleted:60f7f7c7-fbae-40cb-9c19-1eee4b18171b for instance 8d7e9281-594b-413f-950a-9c225b3ff0ae on hv-cinder-83736 May 17 18:21:49.393424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-0cc284ae-7ab5-4341-b9c0-e7379a60c4e5 req-d3e28a40-598e-4919-8241-09adef688f99 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031247 May 17 18:21:49.394042 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 208/473] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:50.378351 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6a8e69be-c86d-4aef-b24b-2c95de3abe65 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:50.378966 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6a8e69be-c86d-4aef-b24b-2c95de3abe65 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:50.379109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7eb194dd-0a7c-4559-b20a-a3ab15755f80 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:50.379774 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7eb194dd-0a7c-4559-b20a-a3ab15755f80 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] [instance: 8d7e9281-594b-413f-950a-9c225b3ff0ae] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:50.386149 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6a8e69be-c86d-4aef-b24b-2c95de3abe65 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:50.386475 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7eb194dd-0a7c-4559-b20a-a3ab15755f80 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:50.386602 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6a8e69be-c86d-4aef-b24b-2c95de3abe65 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:50.386934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7eb194dd-0a7c-4559-b20a-a3ab15755f80 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:50.387382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6a8e69be-c86d-4aef-b24b-2c95de3abe65 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:50.387697 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7eb194dd-0a7c-4559-b20a-a3ab15755f80 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:50.387815 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6a8e69be-c86d-4aef-b24b-2c95de3abe65 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:50.388131 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7eb194dd-0a7c-4559-b20a-a3ab15755f80 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:50.400961 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-7eb194dd-0a7c-4559-b20a-a3ab15755f80 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] HTTP exception thrown: Instance 8d7e9281-594b-413f-950a-9c225b3ff0ae could not be found. May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7eb194dd-0a7c-4559-b20a-a3ab15755f80 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Request method failure captured: May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae HTTP/1.1 May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-cNn1Jveh5qtp4LEWZo1iGfdzmv_mDMA1meI1wszB5cXEWTU5vovpkLk9At8v-uV0xzQy2gsRwhT34clA50hziWwCt2XL86SiCQwOlXpUkfYYXenk4r4WyjBp4-wHsWvA16TGzoYHahOrPVoGmRn8Y_8aTPTYaq6Ry2rPCt7b8oXOc May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 80d1667aeb814212abe473f58d0ff420 May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-VolumesSnapshotTestJSON-418095008 May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:21:50.402676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_80d1667aeb814212abe473f58d0ff420"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/80d1667aeb814212abe473f58d0ff420"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/80d1667aeb814212abe473f58d0ff420"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/80d1667aeb814212abe473f58d0ff420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-VolumesSnapshotTestJSON-418095008 May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 80d1667aeb814212abe473f58d0ff420 May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-418095008 May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-VolumesSnapshotTestJSON-418095008-project May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 8dc55bbbc4a544909a8c80d9638c3ea6 May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-VolumesSnapshotTestJSON-418095008-project May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 8d7e9281-594b-413f-950a-9c225b3ff0ae could not be found. May 17 18:21:50.404102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '8d7e9281-594b-413f-950a-9c225b3ff0ae'} May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d7e9281-594b-413f-950a-9c225b3ff0ae could not be found. May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:21:50.404986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d7e9281-594b-413f-950a-9c225b3ff0ae could not be found. May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d7e9281-594b-413f-950a-9c225b3ff0ae could not be found. May 17 18:21:50.406332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:21:50.407399 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7eb194dd-0a7c-4559-b20a-a3ab15755f80 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] Returning 404 to user: Instance 8d7e9281-594b-413f-950a-9c225b3ff0ae could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:21:50.407399 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7eb194dd-0a7c-4559-b20a-a3ab15755f80 tempest-VolumesSnapshotTestJSON-418095008 tempest-VolumesSnapshotTestJSON-418095008-project] 10.222.0.65 "GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae" status: 404 len: 111 microversion: 2.1 time: 0.029483 May 17 18:21:50.407399 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 209/474] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:50 2022] GET /compute/v2.1/servers/8d7e9281-594b-413f-950a-9c225b3ff0ae => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 18:21:50.515192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6a8e69be-c86d-4aef-b24b-2c95de3abe65 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:50.522558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6a8e69be-c86d-4aef-b24b-2c95de3abe65 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.148189 May 17 18:21:50.523117 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 266/475] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:50 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:51.539810 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-acf470dc-0646-48cd-8aa6-807f10578e1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:51.540955 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-acf470dc-0646-48cd-8aa6-807f10578e1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:51.547507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-acf470dc-0646-48cd-8aa6-807f10578e1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:51.547964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-acf470dc-0646-48cd-8aa6-807f10578e1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:51.548742 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-acf470dc-0646-48cd-8aa6-807f10578e1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:51.549181 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-acf470dc-0646-48cd-8aa6-807f10578e1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:51.678860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-acf470dc-0646-48cd-8aa6-807f10578e1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:51.688136 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-acf470dc-0646-48cd-8aa6-807f10578e1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.151960 May 17 18:21:51.689097 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 210/476] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:51 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:52.705623 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-940e4a1e-6a84-4625-aa07-4fc0d17b4998 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:52.706277 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-940e4a1e-6a84-4625-aa07-4fc0d17b4998 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:52.712341 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-940e4a1e-6a84-4625-aa07-4fc0d17b4998 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:52.712797 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-940e4a1e-6a84-4625-aa07-4fc0d17b4998 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:52.713588 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-940e4a1e-6a84-4625-aa07-4fc0d17b4998 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:52.714032 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-940e4a1e-6a84-4625-aa07-4fc0d17b4998 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:52.846009 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-940e4a1e-6a84-4625-aa07-4fc0d17b4998 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:52.853791 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-940e4a1e-6a84-4625-aa07-4fc0d17b4998 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.152080 May 17 18:21:52.854380 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 267/477] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:52 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:53.870853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5eef7dbe-93f3-43f9-9b3e-9132bbc9223d tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:53.871474 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5eef7dbe-93f3-43f9-9b3e-9132bbc9223d tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:53.877578 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5eef7dbe-93f3-43f9-9b3e-9132bbc9223d tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:53.878064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5eef7dbe-93f3-43f9-9b3e-9132bbc9223d tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:53.878842 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5eef7dbe-93f3-43f9-9b3e-9132bbc9223d tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:53.879290 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5eef7dbe-93f3-43f9-9b3e-9132bbc9223d tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:54.006121 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5eef7dbe-93f3-43f9-9b3e-9132bbc9223d tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:54.014039 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5eef7dbe-93f3-43f9-9b3e-9132bbc9223d tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.146955 May 17 18:21:54.015018 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 211/478] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:53 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:55.030876 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-52e970e4-a65e-4c45-94db-8c762fb0afbb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:55.031517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-52e970e4-a65e-4c45-94db-8c762fb0afbb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:55.037855 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52e970e4-a65e-4c45-94db-8c762fb0afbb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:55.038307 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52e970e4-a65e-4c45-94db-8c762fb0afbb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:55.039070 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52e970e4-a65e-4c45-94db-8c762fb0afbb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:55.039516 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52e970e4-a65e-4c45-94db-8c762fb0afbb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:55.168769 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-52e970e4-a65e-4c45-94db-8c762fb0afbb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:55.175978 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-52e970e4-a65e-4c45-94db-8c762fb0afbb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.148980 May 17 18:21:55.176562 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 268/479] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:55 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:55.637260 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d728f184-aa7a-4810-b52f-94537ace7e5a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:55.637858 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d728f184-aa7a-4810-b52f-94537ace7e5a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:55.644161 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d728f184-aa7a-4810-b52f-94537ace7e5a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:55.644617 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d728f184-aa7a-4810-b52f-94537ace7e5a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:55.645419 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d728f184-aa7a-4810-b52f-94537ace7e5a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:55.645888 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d728f184-aa7a-4810-b52f-94537ace7e5a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:55.670213 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d728f184-aa7a-4810-b52f-94537ace7e5a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/ips" status: 200 len: 144 microversion: 2.1 time: 0.036947 May 17 18:21:55.670765 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 212/480] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 17 18:21:55 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:56.193035 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ed2b4682-2395-4c0a-af78-611a6dbcd916 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:56.193685 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ed2b4682-2395-4c0a-af78-611a6dbcd916 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:56.201307 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed2b4682-2395-4c0a-af78-611a6dbcd916 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:56.201850 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed2b4682-2395-4c0a-af78-611a6dbcd916 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:56.202598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed2b4682-2395-4c0a-af78-611a6dbcd916 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:56.203084 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed2b4682-2395-4c0a-af78-611a6dbcd916 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:56.335077 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ed2b4682-2395-4c0a-af78-611a6dbcd916 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:56.342584 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ed2b4682-2395-4c0a-af78-611a6dbcd916 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.153423 May 17 18:21:56.343154 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 269/481] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:56 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:56.425808 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-b47745ef-f66d-4f77-9945-fbfae3d216d6 req-23fb795b-dcbf-4bb9-b6e8-54746b6c721d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef769ce-3ca7-4bbd-84dd-567ed0af61b9", "name": "network-vif-plugged", "status": "completed", "tag": "14f3ea7b-33ca-4752-b87b-d34d49e5b90c"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:56.434760 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-b47745ef-f66d-4f77-9945-fbfae3d216d6 req-23fb795b-dcbf-4bb9-b6e8-54746b6c721d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:56.435217 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-b47745ef-f66d-4f77-9945-fbfae3d216d6 req-23fb795b-dcbf-4bb9-b6e8-54746b6c721d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:56.447393 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-b47745ef-f66d-4f77-9945-fbfae3d216d6 req-23fb795b-dcbf-4bb9-b6e8-54746b6c721d service nova] Creating event network-vif-plugged:14f3ea7b-33ca-4752-b87b-d34d49e5b90c for instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 on hv-cinder-83736 May 17 18:21:56.452586 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-b47745ef-f66d-4f77-9945-fbfae3d216d6 req-23fb795b-dcbf-4bb9-b6e8-54746b6c721d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030442 May 17 18:21:56.453355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 213/482] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:57.359284 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ac3fe4a2-8561-40f4-9905-ac240b957972 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:57.359907 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ac3fe4a2-8561-40f4-9905-ac240b957972 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:57.366621 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ac3fe4a2-8561-40f4-9905-ac240b957972 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:57.367084 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ac3fe4a2-8561-40f4-9905-ac240b957972 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:57.367857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ac3fe4a2-8561-40f4-9905-ac240b957972 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:57.368815 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ac3fe4a2-8561-40f4-9905-ac240b957972 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:57.498796 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ac3fe4a2-8561-40f4-9905-ac240b957972 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:57.506127 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ac3fe4a2-8561-40f4-9905-ac240b957972 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.150762 May 17 18:21:57.506694 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 270/483] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:57 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:58.038461 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-aa46ef91-6480-4cee-b3e4-71044b4a2481 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b6a97e8-eb7a-4f0b-8b5c-5f30f1093449"}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:21:58.039964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-aa46ef91-6480-4cee-b3e4-71044b4a2481 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:58.046543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aa46ef91-6480-4cee-b3e4-71044b4a2481 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:58.046988 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aa46ef91-6480-4cee-b3e4-71044b4a2481 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:58.047748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aa46ef91-6480-4cee-b3e4-71044b4a2481 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:58.048182 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aa46ef91-6480-4cee-b3e4-71044b4a2481 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:58.309336 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-aa46ef91-6480-4cee-b3e4-71044b4a2481 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "POST /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275505 May 17 18:21:58.314600 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 214/484] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:21:58 2022] POST /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:21:58.522680 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4ae55d07-fa60-4a22-ba6f-59b383191575 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:58.523319 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4ae55d07-fa60-4a22-ba6f-59b383191575 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:58.530234 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4ae55d07-fa60-4a22-ba6f-59b383191575 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:58.530682 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4ae55d07-fa60-4a22-ba6f-59b383191575 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:58.531446 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4ae55d07-fa60-4a22-ba6f-59b383191575 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:58.531880 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4ae55d07-fa60-4a22-ba6f-59b383191575 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:58.657453 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4ae55d07-fa60-4a22-ba6f-59b383191575 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:58.664674 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4ae55d07-fa60-4a22-ba6f-59b383191575 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1264 microversion: 2.1 time: 0.145849 May 17 18:21:58.665228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 271/485] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:58 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:59.683633 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0257c434-3a6e-4bd7-befc-76b7a46b50d9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:59.684346 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0257c434-3a6e-4bd7-befc-76b7a46b50d9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:59.690769 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0257c434-3a6e-4bd7-befc-76b7a46b50d9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.691473 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0257c434-3a6e-4bd7-befc-76b7a46b50d9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.692374 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0257c434-3a6e-4bd7-befc-76b7a46b50d9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.692828 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0257c434-3a6e-4bd7-befc-76b7a46b50d9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.828252 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0257c434-3a6e-4bd7-befc-76b7a46b50d9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:59.836095 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0257c434-3a6e-4bd7-befc-76b7a46b50d9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1451 microversion: 2.1 time: 0.158033 May 17 18:21:59.836658 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 215/486] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:59 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:21:59.853139 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4972c51c-f420-446e-8369-8b6ae13cfeaa tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:21:59.853739 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4972c51c-f420-446e-8369-8b6ae13cfeaa tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:21:59.860185 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4972c51c-f420-446e-8369-8b6ae13cfeaa tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.860635 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4972c51c-f420-446e-8369-8b6ae13cfeaa tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.861399 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4972c51c-f420-446e-8369-8b6ae13cfeaa tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:21:59.861854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4972c51c-f420-446e-8369-8b6ae13cfeaa tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:21:59.991457 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4972c51c-f420-446e-8369-8b6ae13cfeaa tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:21:59.998738 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4972c51c-f420-446e-8369-8b6ae13cfeaa tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1451 microversion: 2.1 time: 0.149792 May 17 18:21:59.999310 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 272/487] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:21:59 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:01.911507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-6f49f5c5-7c5a-406e-9819-2b6ef5849ddb req-3b25e924-9a42-4b1d-bc76-a7314bb790e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ef769ce-3ca7-4bbd-84dd-567ed0af61b9", "tag": "14f3ea7b-33ca-4752-b87b-d34d49e5b90c"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:01.920480 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-6f49f5c5-7c5a-406e-9819-2b6ef5849ddb req-3b25e924-9a42-4b1d-bc76-a7314bb790e7 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:01.921016 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-6f49f5c5-7c5a-406e-9819-2b6ef5849ddb req-3b25e924-9a42-4b1d-bc76-a7314bb790e7 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:01.932477 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-6f49f5c5-7c5a-406e-9819-2b6ef5849ddb req-3b25e924-9a42-4b1d-bc76-a7314bb790e7 service nova] Creating event network-changed:14f3ea7b-33ca-4752-b87b-d34d49e5b90c for instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 on hv-cinder-83736 May 17 18:22:01.937402 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-6f49f5c5-7c5a-406e-9819-2b6ef5849ddb req-3b25e924-9a42-4b1d-bc76-a7314bb790e7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029527 May 17 18:22:01.938028 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 216/488] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:22:07.881091 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9a9e0d14-8e88-4265-a5af-4bdbe47d52d7 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:07.887995 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9a9e0d14-8e88-4265-a5af-4bdbe47d52d7 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:07.888449 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9a9e0d14-8e88-4265-a5af-4bdbe47d52d7 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:07.950080 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9a9e0d14-8e88-4265-a5af-4bdbe47d52d7 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Going to try to stop instance {{(pid=117098) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 18:22:07.992056 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9a9e0d14-8e88-4265-a5af-4bdbe47d52d7 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "POST /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/action" status: 202 len: 0 microversion: 2.1 time: 0.114670 May 17 18:22:07.992709 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 273/489] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:22:07 2022] POST /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:22:08.001836 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8a08ad1a-59a2-496d-924d-2a1fe2d3a638 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:08.003155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8a08ad1a-59a2-496d-924d-2a1fe2d3a638 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:08.010416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8a08ad1a-59a2-496d-924d-2a1fe2d3a638 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:08.010873 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8a08ad1a-59a2-496d-924d-2a1fe2d3a638 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:08.012148 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8a08ad1a-59a2-496d-924d-2a1fe2d3a638 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:08.012763 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8a08ad1a-59a2-496d-924d-2a1fe2d3a638 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:08.142663 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8a08ad1a-59a2-496d-924d-2a1fe2d3a638 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:08.151030 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8a08ad1a-59a2-496d-924d-2a1fe2d3a638 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1723 microversion: 2.1 time: 0.153267 May 17 18:22:08.151587 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 217/490] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:07 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:09.170340 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ef72d935-a221-4333-b114-ebee9ce3270a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:09.171040 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ef72d935-a221-4333-b114-ebee9ce3270a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:09.177332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ef72d935-a221-4333-b114-ebee9ce3270a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:09.177915 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ef72d935-a221-4333-b114-ebee9ce3270a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:09.178658 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ef72d935-a221-4333-b114-ebee9ce3270a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:09.179193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ef72d935-a221-4333-b114-ebee9ce3270a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:09.306000 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ef72d935-a221-4333-b114-ebee9ce3270a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:09.313780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ef72d935-a221-4333-b114-ebee9ce3270a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1723 microversion: 2.1 time: 0.149044 May 17 18:22:09.314348 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 274/491] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:09 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:10.331009 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-955c18b1-1855-456e-ab1d-8cfb38e225ae tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:10.331626 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-955c18b1-1855-456e-ab1d-8cfb38e225ae tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:10.338055 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-955c18b1-1855-456e-ab1d-8cfb38e225ae tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:10.338512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-955c18b1-1855-456e-ab1d-8cfb38e225ae tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:10.339283 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-955c18b1-1855-456e-ab1d-8cfb38e225ae tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:10.339724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-955c18b1-1855-456e-ab1d-8cfb38e225ae tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:10.474159 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-955c18b1-1855-456e-ab1d-8cfb38e225ae tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:10.482489 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-955c18b1-1855-456e-ab1d-8cfb38e225ae tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1723 microversion: 2.1 time: 0.155337 May 17 18:22:10.483048 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 218/492] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:10 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:11.500081 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6db80008-d737-4cd3-b3c1-261450cb245b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:11.500698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6db80008-d737-4cd3-b3c1-261450cb245b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:11.507058 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6db80008-d737-4cd3-b3c1-261450cb245b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:11.507508 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6db80008-d737-4cd3-b3c1-261450cb245b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:11.508305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6db80008-d737-4cd3-b3c1-261450cb245b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:11.508746 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6db80008-d737-4cd3-b3c1-261450cb245b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:11.632144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6db80008-d737-4cd3-b3c1-261450cb245b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:11.640475 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6db80008-d737-4cd3-b3c1-261450cb245b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1723 microversion: 2.1 time: 0.144276 May 17 18:22:11.641034 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 275/493] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:11 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1723 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:12.657236 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-53c142ef-d4a2-490e-953e-b756ebf5678c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:12.657871 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-53c142ef-d4a2-490e-953e-b756ebf5678c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:12.664373 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-53c142ef-d4a2-490e-953e-b756ebf5678c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:12.664829 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-53c142ef-d4a2-490e-953e-b756ebf5678c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:12.665635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-53c142ef-d4a2-490e-953e-b756ebf5678c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:12.666077 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-53c142ef-d4a2-490e-953e-b756ebf5678c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:12.794452 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-53c142ef-d4a2-490e-953e-b756ebf5678c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:12.802270 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-53c142ef-d4a2-490e-953e-b756ebf5678c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1723 microversion: 2.1 time: 0.148892 May 17 18:22:12.802828 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 219/494] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:12 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:13.819014 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6cb13e78-e3bf-4130-a7e2-11ed02ae2f2d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:13.819624 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6cb13e78-e3bf-4130-a7e2-11ed02ae2f2d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:13.826458 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6cb13e78-e3bf-4130-a7e2-11ed02ae2f2d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:13.826938 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6cb13e78-e3bf-4130-a7e2-11ed02ae2f2d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:13.827915 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6cb13e78-e3bf-4130-a7e2-11ed02ae2f2d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:13.828513 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6cb13e78-e3bf-4130-a7e2-11ed02ae2f2d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:13.953967 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6cb13e78-e3bf-4130-a7e2-11ed02ae2f2d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:13.961816 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6cb13e78-e3bf-4130-a7e2-11ed02ae2f2d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1723 microversion: 2.1 time: 0.146574 May 17 18:22:13.962384 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 276/495] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:13 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:14.980298 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-35d37139-cb3d-49f4-bbf8-63bedf539390 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:14.980903 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-35d37139-cb3d-49f4-bbf8-63bedf539390 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:14.987434 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-35d37139-cb3d-49f4-bbf8-63bedf539390 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:14.987928 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-35d37139-cb3d-49f4-bbf8-63bedf539390 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:14.988701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-35d37139-cb3d-49f4-bbf8-63bedf539390 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:14.989173 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-35d37139-cb3d-49f4-bbf8-63bedf539390 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:15.113742 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-35d37139-cb3d-49f4-bbf8-63bedf539390 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:15.121498 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-35d37139-cb3d-49f4-bbf8-63bedf539390 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1723 microversion: 2.1 time: 0.145617 May 17 18:22:15.122053 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 220/496] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:14 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1723 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:16.138034 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cc1594a0-a277-4258-8310-5b1cb580b11c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:16.138646 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cc1594a0-a277-4258-8310-5b1cb580b11c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:16.145096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc1594a0-a277-4258-8310-5b1cb580b11c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:16.145585 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc1594a0-a277-4258-8310-5b1cb580b11c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:16.146354 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc1594a0-a277-4258-8310-5b1cb580b11c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:16.146790 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc1594a0-a277-4258-8310-5b1cb580b11c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:16.274342 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cc1594a0-a277-4258-8310-5b1cb580b11c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:16.282049 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cc1594a0-a277-4258-8310-5b1cb580b11c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1723 microversion: 2.1 time: 0.147925 May 17 18:22:16.282607 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 277/497] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:16 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:17.298681 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-aebd921d-abcc-4995-ba83-e76742fb3eb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:17.299433 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-aebd921d-abcc-4995-ba83-e76742fb3eb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:17.306626 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aebd921d-abcc-4995-ba83-e76742fb3eb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:17.307086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aebd921d-abcc-4995-ba83-e76742fb3eb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:17.308398 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aebd921d-abcc-4995-ba83-e76742fb3eb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:17.308846 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aebd921d-abcc-4995-ba83-e76742fb3eb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:17.447811 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-aebd921d-abcc-4995-ba83-e76742fb3eb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:17.456857 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-aebd921d-abcc-4995-ba83-e76742fb3eb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1723 microversion: 2.1 time: 0.162250 May 17 18:22:17.457927 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 221/498] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:17 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:18.474014 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fdcc3656-541a-410e-944a-abc25c3f6bee tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:18.474636 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fdcc3656-541a-410e-944a-abc25c3f6bee tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:18.481201 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fdcc3656-541a-410e-944a-abc25c3f6bee tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:18.481712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fdcc3656-541a-410e-944a-abc25c3f6bee tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:18.482493 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fdcc3656-541a-410e-944a-abc25c3f6bee tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:18.482949 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fdcc3656-541a-410e-944a-abc25c3f6bee tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:18.620613 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fdcc3656-541a-410e-944a-abc25c3f6bee tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:18.630030 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fdcc3656-541a-410e-944a-abc25c3f6bee tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1700 microversion: 2.1 time: 0.159134 May 17 18:22:18.630030 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 278/499] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:18 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1700 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:18.646235 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7d9ef6a9-c520-4a9f-893d-7f8243f0279d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:18.653253 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7d9ef6a9-c520-4a9f-893d-7f8243f0279d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:18.653911 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7d9ef6a9-c520-4a9f-893d-7f8243f0279d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:18.722416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7d9ef6a9-c520-4a9f-893d-7f8243f0279d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Going to try to start instance {{(pid=117099) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 18:22:18.796807 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7d9ef6a9-c520-4a9f-893d-7f8243f0279d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "POST /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/action" status: 202 len: 0 microversion: 2.1 time: 0.154245 May 17 18:22:18.797907 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 222/500] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:22:18 2022] POST /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/action => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:22:18.806341 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7a75b2ac-26e8-4569-a7cc-5d82ca1201cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:18.807851 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7a75b2ac-26e8-4569-a7cc-5d82ca1201cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:18.814423 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7a75b2ac-26e8-4569-a7cc-5d82ca1201cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:18.815139 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7a75b2ac-26e8-4569-a7cc-5d82ca1201cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:18.816327 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7a75b2ac-26e8-4569-a7cc-5d82ca1201cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:18.816925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7a75b2ac-26e8-4569-a7cc-5d82ca1201cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:19.105421 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7a75b2ac-26e8-4569-a7cc-5d82ca1201cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:19.118897 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7a75b2ac-26e8-4569-a7cc-5d82ca1201cf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1709 microversion: 2.1 time: 0.316595 May 17 18:22:19.120086 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 279/501] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:18 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1709 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:20.137110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c0ba55e8-cdc4-4e7b-be67-a26890ad093d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:20.138457 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c0ba55e8-cdc4-4e7b-be67-a26890ad093d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:20.144934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c0ba55e8-cdc4-4e7b-be67-a26890ad093d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:20.145385 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c0ba55e8-cdc4-4e7b-be67-a26890ad093d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:20.146388 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c0ba55e8-cdc4-4e7b-be67-a26890ad093d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:20.146828 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c0ba55e8-cdc4-4e7b-be67-a26890ad093d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:20.400282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c0ba55e8-cdc4-4e7b-be67-a26890ad093d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:20.408813 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c0ba55e8-cdc4-4e7b-be67-a26890ad093d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1709 microversion: 2.1 time: 0.276361 May 17 18:22:20.409382 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 223/502] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:20 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1709 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:21.426051 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ca2b0a2d-9575-4523-b1a4-6fd83674242e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:21.426676 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ca2b0a2d-9575-4523-b1a4-6fd83674242e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:21.435528 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ca2b0a2d-9575-4523-b1a4-6fd83674242e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:21.436077 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ca2b0a2d-9575-4523-b1a4-6fd83674242e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:21.441250 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ca2b0a2d-9575-4523-b1a4-6fd83674242e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:21.442534 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ca2b0a2d-9575-4523-b1a4-6fd83674242e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:21.691371 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ca2b0a2d-9575-4523-b1a4-6fd83674242e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:21.702449 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ca2b0a2d-9575-4523-b1a4-6fd83674242e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1713 microversion: 2.1 time: 0.280203 May 17 18:22:21.703608 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 280/503] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:21 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1713 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:24.101708 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e9e06254-da2d-4d44-8234-e9f58f12ae0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:24.102202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e9e06254-da2d-4d44-8234-e9f58f12ae0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:24.110859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e9e06254-da2d-4d44-8234-e9f58f12ae0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:24.112228 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e9e06254-da2d-4d44-8234-e9f58f12ae0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:24.113204 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e9e06254-da2d-4d44-8234-e9f58f12ae0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:24.114033 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e9e06254-da2d-4d44-8234-e9f58f12ae0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:24.138810 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e9e06254-da2d-4d44-8234-e9f58f12ae0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/ips" status: 200 len: 152 microversion: 2.20 time: 0.044156 May 17 18:22:24.144777 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 224/504] 10.222.0.65 () {60 vars in 1288 bytes} [Tue May 17 18:22:24 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/ips => generated 152 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:22:24.974998 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-94e2c104-bbec-41c3-943d-4344ba1b138e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:24.976079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-94e2c104-bbec-41c3-943d-4344ba1b138e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:24.990306 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-94e2c104-bbec-41c3-943d-4344ba1b138e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:24.991784 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-94e2c104-bbec-41c3-943d-4344ba1b138e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:24.992679 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-94e2c104-bbec-41c3-943d-4344ba1b138e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:24.999870 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-94e2c104-bbec-41c3-943d-4344ba1b138e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:25.035298 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-94e2c104-bbec-41c3-943d-4344ba1b138e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/ips" status: 200 len: 148 microversion: 2.1 time: 0.066257 May 17 18:22:25.037570 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 281/505] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 17 18:22:24 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/ips => generated 148 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:22:26.176072 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-13e0a407-a925-42b6-b472-8ca4f07ae2f0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:26.177499 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-13e0a407-a925-42b6-b472-8ca4f07ae2f0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:26.186393 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-13e0a407-a925-42b6-b472-8ca4f07ae2f0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:26.187410 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-13e0a407-a925-42b6-b472-8ca4f07ae2f0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:26.188590 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-13e0a407-a925-42b6-b472-8ca4f07ae2f0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:26.189329 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-13e0a407-a925-42b6-b472-8ca4f07ae2f0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:26.238985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-13e0a407-a925-42b6-b472-8ca4f07ae2f0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lazy-loading 'flavor' on Instance uuid 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:22:26.750492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d8efdeff-b05c-47ea-8f3b-002e03a3d319 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb5ccbf2-0019-4baa-82bd-af51446cfe08"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:26.755609 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d8efdeff-b05c-47ea-8f3b-002e03a3d319 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:26.773889 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8efdeff-b05c-47ea-8f3b-002e03a3d319 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:26.777816 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8efdeff-b05c-47ea-8f3b-002e03a3d319 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:26.779147 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8efdeff-b05c-47ea-8f3b-002e03a3d319 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:26.781677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8efdeff-b05c-47ea-8f3b-002e03a3d319 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:26.786176 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-13e0a407-a925-42b6-b472-8ca4f07ae2f0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "POST /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/action" status: 202 len: 0 microversion: 2.20 time: 0.615173 May 17 18:22:26.790656 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 225/506] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 17 18:22:26 2022] POST /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/action => generated 0 bytes in 623 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 18:22:26.807257 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e274cad7-3c54-4788-a735-94a8cc4d03c7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:26.808297 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e274cad7-3c54-4788-a735-94a8cc4d03c7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:26.836206 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e274cad7-3c54-4788-a735-94a8cc4d03c7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:26.837985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e274cad7-3c54-4788-a735-94a8cc4d03c7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:26.839157 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e274cad7-3c54-4788-a735-94a8cc4d03c7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:26.839608 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e274cad7-3c54-4788-a735-94a8cc4d03c7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:27.124157 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e274cad7-3c54-4788-a735-94a8cc4d03c7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:27.132635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e274cad7-3c54-4788-a735-94a8cc4d03c7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:27.136597 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e274cad7-3c54-4788-a735-94a8cc4d03c7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:27.140929 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e274cad7-3c54-4788-a735-94a8cc4d03c7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.347683 May 17 18:22:27.144651 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 226/507] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:26 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:27.218323 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d8efdeff-b05c-47ea-8f3b-002e03a3d319 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.481803 May 17 18:22:27.219268 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 282/508] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:22:26 2022] POST /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/os-volume_attachments => generated 194 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:22:28.162564 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0c0383ac-fb18-400a-a876-01f9a61bb325 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:28.163748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0c0383ac-fb18-400a-a876-01f9a61bb325 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:28.171514 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0c0383ac-fb18-400a-a876-01f9a61bb325 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:28.172094 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0c0383ac-fb18-400a-a876-01f9a61bb325 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:28.172954 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0c0383ac-fb18-400a-a876-01f9a61bb325 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:28.173489 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0c0383ac-fb18-400a-a876-01f9a61bb325 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:28.555798 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0c0383ac-fb18-400a-a876-01f9a61bb325 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:28.564713 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0c0383ac-fb18-400a-a876-01f9a61bb325 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:28.566885 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0c0383ac-fb18-400a-a876-01f9a61bb325 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:28.568228 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0c0383ac-fb18-400a-a876-01f9a61bb325 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.412064 May 17 18:22:28.568789 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 227/509] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:28 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:29.588033 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-492b2105-b23e-424a-8f3c-9514ad64d2a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:29.589400 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-492b2105-b23e-424a-8f3c-9514ad64d2a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:29.599787 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-492b2105-b23e-424a-8f3c-9514ad64d2a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:29.600875 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-492b2105-b23e-424a-8f3c-9514ad64d2a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:29.601854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-492b2105-b23e-424a-8f3c-9514ad64d2a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:29.602507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-492b2105-b23e-424a-8f3c-9514ad64d2a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:29.876528 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-492b2105-b23e-424a-8f3c-9514ad64d2a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:29.891823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-492b2105-b23e-424a-8f3c-9514ad64d2a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:29.894400 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-492b2105-b23e-424a-8f3c-9514ad64d2a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:29.895795 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-492b2105-b23e-424a-8f3c-9514ad64d2a8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.312373 May 17 18:22:29.896854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 283/510] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:29 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:30.918070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-32b44cdf-2c6f-406a-9922-7e4dd00b1d13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:30.919272 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-32b44cdf-2c6f-406a-9922-7e4dd00b1d13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:30.930946 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32b44cdf-2c6f-406a-9922-7e4dd00b1d13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:30.935441 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32b44cdf-2c6f-406a-9922-7e4dd00b1d13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:30.936446 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32b44cdf-2c6f-406a-9922-7e4dd00b1d13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:30.938869 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32b44cdf-2c6f-406a-9922-7e4dd00b1d13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:31.120411 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-32b44cdf-2c6f-406a-9922-7e4dd00b1d13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:31.130784 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-32b44cdf-2c6f-406a-9922-7e4dd00b1d13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:31.132930 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-32b44cdf-2c6f-406a-9922-7e4dd00b1d13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:31.134599 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-32b44cdf-2c6f-406a-9922-7e4dd00b1d13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.223174 May 17 18:22:31.146539 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 228/511] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:30 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:22:32.153754 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-78b4bc01-b8c9-4161-874c-ff06c88bcae8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:32.155096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-78b4bc01-b8c9-4161-874c-ff06c88bcae8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:32.161970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78b4bc01-b8c9-4161-874c-ff06c88bcae8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:32.162448 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78b4bc01-b8c9-4161-874c-ff06c88bcae8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:32.163593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78b4bc01-b8c9-4161-874c-ff06c88bcae8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:32.164039 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-78b4bc01-b8c9-4161-874c-ff06c88bcae8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:32.310673 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-78b4bc01-b8c9-4161-874c-ff06c88bcae8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:32.318579 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-78b4bc01-b8c9-4161-874c-ff06c88bcae8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:32.320159 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-78b4bc01-b8c9-4161-874c-ff06c88bcae8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:32.321330 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-78b4bc01-b8c9-4161-874c-ff06c88bcae8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.171838 May 17 18:22:32.332372 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 284/512] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:32 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:33.340907 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9980dc97-41e1-4b8d-a480-15a145bad607 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:33.341552 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-9980dc97-41e1-4b8d-a480-15a145bad607 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:33.354956 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9980dc97-41e1-4b8d-a480-15a145bad607 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:33.355326 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9980dc97-41e1-4b8d-a480-15a145bad607 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:33.356116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9980dc97-41e1-4b8d-a480-15a145bad607 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:33.356556 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9980dc97-41e1-4b8d-a480-15a145bad607 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:33.527466 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-9980dc97-41e1-4b8d-a480-15a145bad607 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:33.536168 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-9980dc97-41e1-4b8d-a480-15a145bad607 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:33.537947 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-9980dc97-41e1-4b8d-a480-15a145bad607 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:33.539139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9980dc97-41e1-4b8d-a480-15a145bad607 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.203089 May 17 18:22:33.539861 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 229/513] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:33 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:34.558324 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0f365e55-6925-4c74-a023-3cf3df4f0516 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:34.559583 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0f365e55-6925-4c74-a023-3cf3df4f0516 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:34.566016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0f365e55-6925-4c74-a023-3cf3df4f0516 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:34.566670 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0f365e55-6925-4c74-a023-3cf3df4f0516 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:34.567651 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0f365e55-6925-4c74-a023-3cf3df4f0516 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:34.568083 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0f365e55-6925-4c74-a023-3cf3df4f0516 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:34.734645 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0f365e55-6925-4c74-a023-3cf3df4f0516 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:34.745730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0f365e55-6925-4c74-a023-3cf3df4f0516 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:34.747292 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0f365e55-6925-4c74-a023-3cf3df4f0516 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:34.748469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0f365e55-6925-4c74-a023-3cf3df4f0516 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.194561 May 17 18:22:34.759501 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 285/514] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:34 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:34.892008 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b91148c8-89ed-4c2b-ba2d-dbc9c4b1a9a7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: .version_select at 0x7f4e6049ce50>, body: {"keypair": {"name": "tempest-keypair-1614074586", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfdT/epPyXOq9z0FyIAKcJHAKZ5l4rBbhHc+8lI0qKOUd74tj6glgSV1hQa65ffYHtvTruUbqmYy3xx61AY7NQ3Qj5Rnr3j3J/Ap22futT1rBqQHJrDFaWnmwwQ5Vvkyg=="}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:34.907346 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-b91148c8-89ed-4c2b-ba2d-dbc9c4b1a9a7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'key_pairs'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:22:34.913092 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-b91148c8-89ed-4c2b-ba2d-dbc9c4b1a9a7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for user 13b4ec46d3cb49faba3f063dcfd644c3 and project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'key_pairs'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:22:34.944221 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b91148c8-89ed-4c2b-ba2d-dbc9c4b1a9a7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055971 May 17 18:22:34.950182 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 230/515] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 17 18:22:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:22:35.766686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-43288f0c-3d93-41bb-8edf-25a6f3715a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:35.767507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-43288f0c-3d93-41bb-8edf-25a6f3715a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:35.774418 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-43288f0c-3d93-41bb-8edf-25a6f3715a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:35.775155 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-43288f0c-3d93-41bb-8edf-25a6f3715a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:35.776429 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-43288f0c-3d93-41bb-8edf-25a6f3715a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:35.777020 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-43288f0c-3d93-41bb-8edf-25a6f3715a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:36.134810 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-43288f0c-3d93-41bb-8edf-25a6f3715a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:36.147448 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-43288f0c-3d93-41bb-8edf-25a6f3715a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:36.149401 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-43288f0c-3d93-41bb-8edf-25a6f3715a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:36.151432 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-43288f0c-3d93-41bb-8edf-25a6f3715a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.388630 May 17 18:22:36.165474 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 286/516] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:35 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:36.741656 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1870885516", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bbec44d-dbfb-4f33-a578-9ea7e3744727"}], "security_groups": [{"name": "tempest-securitygroup--1320112010"}], "key_name": "tempest-keypair-1614074586", "user_data": "}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:36.860497 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] validate_networks() for [('3bbec44d-dbfb-4f33-a578-9ea7e3744727', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:22:37.176209 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1104020e-b68f-4638-9428-4521b6fad560 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:37.177887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1104020e-b68f-4638-9428-4521b6fad560 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:37.185357 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1104020e-b68f-4638-9428-4521b6fad560 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:37.186165 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1104020e-b68f-4638-9428-4521b6fad560 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:37.187623 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1104020e-b68f-4638-9428-4521b6fad560 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:37.190220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1104020e-b68f-4638-9428-4521b6fad560 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:37.333160 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:22:37.333628 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:22:37.334110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:22:37.334526 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:22:37.334945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:22:37.350876 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:37.351695 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:37.352674 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:37.353745 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:37.376700 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:22:37.382394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for user 13b4ec46d3cb49faba3f063dcfd644c3 and project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:22:37.393698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1104020e-b68f-4638-9428-4521b6fad560 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:37.404766 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1104020e-b68f-4638-9428-4521b6fad560 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:37.406322 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1104020e-b68f-4638-9428-4521b6fad560 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:37.407504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1104020e-b68f-4638-9428-4521b6fad560 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.240275 May 17 18:22:37.410763 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:22:37.413138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:22:37.421871 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 287/517] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:37 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:22:37.471825 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-68d6a023-852a-4a30-afdc-56bfa6e83898 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.735740 May 17 18:22:37.472734 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 231/518] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:22:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:22:37.482630 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-70458ee5-7e39-4f00-b77a-46e274a26113 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:37.483246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-70458ee5-7e39-4f00-b77a-46e274a26113 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:37.551068 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-70458ee5-7e39-4f00-b77a-46e274a26113 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:37.558380 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-70458ee5-7e39-4f00-b77a-46e274a26113 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1242 microversion: 2.1 time: 0.079486 May 17 18:22:37.558956 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 288/519] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:37 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:37.601955 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1a871620-080a-4301-b0bf-328a59490e67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Action: 'create', calling method: .version_select at 0x7f4e6049c820>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-453530016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC5lEaBbSy+QwPK+xchpPO37wZ79Ium0PHT9WYaDaDk7J0s17R15nl/yYmlPiRwcyKlen6q3SoxHXU0r4neQT0G+4yjeW+MYweZEcXz6Adz7vDd/N6lq9ChX05VtoHgnNQ=="}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:37.617109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-1a871620-080a-4301-b0bf-328a59490e67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Getting quotas for project 271959139e4a4e058a5a56cbdfc8cdcb. Resources: {'key_pairs'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:22:37.621514 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-1a871620-080a-4301-b0bf-328a59490e67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Getting quotas for user 5dee3ac46621470a9b5fac6574820e93 and project 271959139e4a4e058a5a56cbdfc8cdcb. Resources: {'key_pairs'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:22:37.644016 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1a871620-080a-4301-b0bf-328a59490e67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046053 May 17 18:22:37.652776 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 232/520] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 17 18:22:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:22:37.691321 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-927290806", "imageRef": "0dc8064a-d475-43f0-98b3-eb076ac5cad0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-453530016", "networks": [{"uuid": "a4568d42-5300-4d85-a01d-63902b8a6e93"}]}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:37.742726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.network.neutron [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] validate_networks() for [('a4568d42-5300-4d85-a01d-63902b8a6e93', None, None, None, None, None)] {{(pid=117098) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:22:38.167713 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Flavor limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:22:38.168238 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Image limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:22:38.168822 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Flavor pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:22:38.169293 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Image pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:22:38.169828 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:22:38.178787 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:38.179363 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:38.180044 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:38.180478 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:38.198214 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Getting quotas for project 271959139e4a4e058a5a56cbdfc8cdcb. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:22:38.202408 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Getting quotas for user 5dee3ac46621470a9b5fac6574820e93 and project 271959139e4a4e058a5a56cbdfc8cdcb. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:22:38.213704 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Going to run 1 instances... {{(pid=117098) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:22:38.216351 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0dc8064a-d475-43f0-98b3-eb076ac5cad0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:22:38.265051 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-40819788-1a73-43d2-8abc-2eb9b5e77bc8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577666 May 17 18:22:38.265742 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 289/521] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:22:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:22:38.278128 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-888f8d91-50ab-4c62-aa0a-a1cf9d5b1d09 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:38.278829 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-888f8d91-50ab-4c62-aa0a-a1cf9d5b1d09 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:38.337316 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-888f8d91-50ab-4c62-aa0a-a1cf9d5b1d09 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:38.344282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-888f8d91-50ab-4c62-aa0a-a1cf9d5b1d09 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1257 microversion: 2.1 time: 0.070516 May 17 18:22:38.344821 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 233/522] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:38 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:38.425398 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9ebc586e-3e24-4ea6-9a00-094834abed02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:38.426133 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9ebc586e-3e24-4ea6-9a00-094834abed02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:38.433269 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9ebc586e-3e24-4ea6-9a00-094834abed02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:38.433752 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9ebc586e-3e24-4ea6-9a00-094834abed02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:38.434534 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9ebc586e-3e24-4ea6-9a00-094834abed02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:38.434975 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9ebc586e-3e24-4ea6-9a00-094834abed02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:38.574020 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9ebc586e-3e24-4ea6-9a00-094834abed02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:38.576814 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-82d8b98a-31ee-4ab8-8582-41a35086eadc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:38.577300 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-82d8b98a-31ee-4ab8-8582-41a35086eadc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:38.583295 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-82d8b98a-31ee-4ab8-8582-41a35086eadc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:38.583748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-82d8b98a-31ee-4ab8-8582-41a35086eadc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:38.584523 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-82d8b98a-31ee-4ab8-8582-41a35086eadc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:38.585136 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-82d8b98a-31ee-4ab8-8582-41a35086eadc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:38.589771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9ebc586e-3e24-4ea6-9a00-094834abed02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:38.591691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9ebc586e-3e24-4ea6-9a00-094834abed02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:38.594197 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9ebc586e-3e24-4ea6-9a00-094834abed02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.172522 May 17 18:22:38.595774 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 290/523] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:38 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:38.666842 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-82d8b98a-31ee-4ab8-8582-41a35086eadc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:38.674934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-82d8b98a-31ee-4ab8-8582-41a35086eadc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1294 microversion: 2.1 time: 0.102884 May 17 18:22:38.676111 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 234/524] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:38 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:22:39.361471 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-317ab6d3-771c-4517-bb02-1604675a9bb2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:39.362510 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-317ab6d3-771c-4517-bb02-1604675a9bb2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:39.370888 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-317ab6d3-771c-4517-bb02-1604675a9bb2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:39.371524 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-317ab6d3-771c-4517-bb02-1604675a9bb2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:39.372677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-317ab6d3-771c-4517-bb02-1604675a9bb2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:39.373187 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-317ab6d3-771c-4517-bb02-1604675a9bb2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:39.466630 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-317ab6d3-771c-4517-bb02-1604675a9bb2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:39.474734 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-317ab6d3-771c-4517-bb02-1604675a9bb2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1327 microversion: 2.1 time: 0.117071 May 17 18:22:39.475372 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 291/525] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:39 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:39.613897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8c1cd976-3829-4237-b9f1-39783936e5fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:39.614614 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8c1cd976-3829-4237-b9f1-39783936e5fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:39.621906 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8c1cd976-3829-4237-b9f1-39783936e5fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:39.622361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8c1cd976-3829-4237-b9f1-39783936e5fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:39.623143 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8c1cd976-3829-4237-b9f1-39783936e5fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:39.623582 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8c1cd976-3829-4237-b9f1-39783936e5fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:39.692134 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7deac17f-62b3-474f-894f-2998472bcd71 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:39.692733 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7deac17f-62b3-474f-894f-2998472bcd71 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:39.705229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7deac17f-62b3-474f-894f-2998472bcd71 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:39.708372 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7deac17f-62b3-474f-894f-2998472bcd71 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:39.713940 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7deac17f-62b3-474f-894f-2998472bcd71 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:39.715045 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7deac17f-62b3-474f-894f-2998472bcd71 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:39.793118 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8c1cd976-3829-4237-b9f1-39783936e5fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:39.807884 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8c1cd976-3829-4237-b9f1-39783936e5fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:39.821663 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8c1cd976-3829-4237-b9f1-39783936e5fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:39.825908 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8c1cd976-3829-4237-b9f1-39783936e5fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.216052 May 17 18:22:39.829945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 235/526] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:39 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:39.963307 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7deac17f-62b3-474f-894f-2998472bcd71 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:39.974400 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7deac17f-62b3-474f-894f-2998472bcd71 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.284941 May 17 18:22:39.986746 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 292/527] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:39 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:40.492324 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-377f898f-6a7b-4f26-b198-dda7a716021d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:40.502760 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-377f898f-6a7b-4f26-b198-dda7a716021d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:40.509662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-377f898f-6a7b-4f26-b198-dda7a716021d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:40.511074 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-377f898f-6a7b-4f26-b198-dda7a716021d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:40.512254 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-377f898f-6a7b-4f26-b198-dda7a716021d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:40.512989 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-377f898f-6a7b-4f26-b198-dda7a716021d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:40.770350 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-377f898f-6a7b-4f26-b198-dda7a716021d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:40.781981 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-377f898f-6a7b-4f26-b198-dda7a716021d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.293568 May 17 18:22:40.783107 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 236/528] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:40 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:40.857603 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6be0b1c2-e3e5-45c1-9973-f91fd23fe4fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:40.861326 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-4ce64a7a-d789-4c58-8115-22d35d222565 req-9c504cdc-8ad7-41b4-b88b-7ddb8e720043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc177fc2-a93f-4490-8e44-0774f508720a", "tag": "de8a891f-5a42-49e2-b6a3-15f94c53ec66"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:40.870585 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6be0b1c2-e3e5-45c1-9973-f91fd23fe4fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:40.887640 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6be0b1c2-e3e5-45c1-9973-f91fd23fe4fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:40.888103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6be0b1c2-e3e5-45c1-9973-f91fd23fe4fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:40.890826 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-4ce64a7a-d789-4c58-8115-22d35d222565 req-9c504cdc-8ad7-41b4-b88b-7ddb8e720043 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:40.891266 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-4ce64a7a-d789-4c58-8115-22d35d222565 req-9c504cdc-8ad7-41b4-b88b-7ddb8e720043 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:40.894192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6be0b1c2-e3e5-45c1-9973-f91fd23fe4fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:40.894843 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6be0b1c2-e3e5-45c1-9973-f91fd23fe4fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:40.929179 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-4ce64a7a-d789-4c58-8115-22d35d222565 req-9c504cdc-8ad7-41b4-b88b-7ddb8e720043 service nova] Creating event network-changed:de8a891f-5a42-49e2-b6a3-15f94c53ec66 for instance cc177fc2-a93f-4490-8e44-0774f508720a on hv-cinder-83736 May 17 18:22:40.937800 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-4ce64a7a-d789-4c58-8115-22d35d222565 req-9c504cdc-8ad7-41b4-b88b-7ddb8e720043 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083360 May 17 18:22:40.940911 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 237/529] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:22:40.994770 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2d6892ba-d788-4c22-8f31-1b31fb0d2d8b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:40.995502 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2d6892ba-d788-4c22-8f31-1b31fb0d2d8b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:41.002428 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2d6892ba-d788-4c22-8f31-1b31fb0d2d8b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:41.003146 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2d6892ba-d788-4c22-8f31-1b31fb0d2d8b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:41.004113 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2d6892ba-d788-4c22-8f31-1b31fb0d2d8b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:41.004720 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2d6892ba-d788-4c22-8f31-1b31fb0d2d8b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:41.171408 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6be0b1c2-e3e5-45c1-9973-f91fd23fe4fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:41.179927 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6be0b1c2-e3e5-45c1-9973-f91fd23fe4fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:41.182909 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6be0b1c2-e3e5-45c1-9973-f91fd23fe4fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:41.184331 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6be0b1c2-e3e5-45c1-9973-f91fd23fe4fa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.335528 May 17 18:22:41.184962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 293/530] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:40 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:41.213209 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2d6892ba-d788-4c22-8f31-1b31fb0d2d8b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:41.223899 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2d6892ba-d788-4c22-8f31-1b31fb0d2d8b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.232478 May 17 18:22:41.224508 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 238/531] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:40 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:22:41.799437 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3e17aac4-ef70-4a37-baef-7505b7ce15dc tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:41.800065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3e17aac4-ef70-4a37-baef-7505b7ce15dc tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:41.806666 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3e17aac4-ef70-4a37-baef-7505b7ce15dc tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:41.807122 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3e17aac4-ef70-4a37-baef-7505b7ce15dc tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:41.807913 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3e17aac4-ef70-4a37-baef-7505b7ce15dc tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:41.808354 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3e17aac4-ef70-4a37-baef-7505b7ce15dc tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:41.941849 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3e17aac4-ef70-4a37-baef-7505b7ce15dc tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:41.950230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3e17aac4-ef70-4a37-baef-7505b7ce15dc tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.154706 May 17 18:22:41.950804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 294/532] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:41 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:42.203443 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-11571458-7754-46c5-945d-aad6e9756419 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:42.203978 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-11571458-7754-46c5-945d-aad6e9756419 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:42.210602 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-11571458-7754-46c5-945d-aad6e9756419 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:42.211293 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-11571458-7754-46c5-945d-aad6e9756419 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:42.212106 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-11571458-7754-46c5-945d-aad6e9756419 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:42.212550 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-11571458-7754-46c5-945d-aad6e9756419 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:42.242824 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c0394e5e-631f-4091-8e99-2dbd4c2b9d9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:42.244338 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c0394e5e-631f-4091-8e99-2dbd4c2b9d9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:42.253743 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0394e5e-631f-4091-8e99-2dbd4c2b9d9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:42.254191 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0394e5e-631f-4091-8e99-2dbd4c2b9d9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:42.255007 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0394e5e-631f-4091-8e99-2dbd4c2b9d9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:42.255579 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0394e5e-631f-4091-8e99-2dbd4c2b9d9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:42.398808 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-11571458-7754-46c5-945d-aad6e9756419 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:42.407519 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-11571458-7754-46c5-945d-aad6e9756419 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:42.409266 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-11571458-7754-46c5-945d-aad6e9756419 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:42.410485 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-11571458-7754-46c5-945d-aad6e9756419 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.211504 May 17 18:22:42.411230 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 239/533] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:42 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:42.427242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c0394e5e-631f-4091-8e99-2dbd4c2b9d9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:42.435532 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c0394e5e-631f-4091-8e99-2dbd4c2b9d9e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.197613 May 17 18:22:42.436122 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 295/534] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:42 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:42.967618 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-bc0a7622-877c-4d9e-a069-f348b312bfbe tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:42.968155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-bc0a7622-877c-4d9e-a069-f348b312bfbe tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:42.974488 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc0a7622-877c-4d9e-a069-f348b312bfbe tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:42.974954 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc0a7622-877c-4d9e-a069-f348b312bfbe tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:42.975747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc0a7622-877c-4d9e-a069-f348b312bfbe tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:42.976198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc0a7622-877c-4d9e-a069-f348b312bfbe tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:43.105952 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bc0a7622-877c-4d9e-a069-f348b312bfbe tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:43.113162 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-bc0a7622-877c-4d9e-a069-f348b312bfbe tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.149502 May 17 18:22:43.113765 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 240/535] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:42 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:43.428248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-44c9763c-a498-4980-96fd-bc41b218bdf5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:43.429885 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-44c9763c-a498-4980-96fd-bc41b218bdf5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:43.436975 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-44c9763c-a498-4980-96fd-bc41b218bdf5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:43.437432 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-44c9763c-a498-4980-96fd-bc41b218bdf5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:43.438246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-44c9763c-a498-4980-96fd-bc41b218bdf5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:43.438685 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-44c9763c-a498-4980-96fd-bc41b218bdf5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:43.452262 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-515e6470-9782-4db9-8e76-5268edd7ed6a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:43.453038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-515e6470-9782-4db9-8e76-5268edd7ed6a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:43.459276 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-515e6470-9782-4db9-8e76-5268edd7ed6a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:43.459791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-515e6470-9782-4db9-8e76-5268edd7ed6a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:43.460619 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-515e6470-9782-4db9-8e76-5268edd7ed6a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:43.461115 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-515e6470-9782-4db9-8e76-5268edd7ed6a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:43.640530 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-44c9763c-a498-4980-96fd-bc41b218bdf5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:43.648537 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-44c9763c-a498-4980-96fd-bc41b218bdf5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:43.650606 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-44c9763c-a498-4980-96fd-bc41b218bdf5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:43.651767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-44c9763c-a498-4980-96fd-bc41b218bdf5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.227596 May 17 18:22:43.662542 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 296/536] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:43 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:43.662891 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-515e6470-9782-4db9-8e76-5268edd7ed6a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:43.667263 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-515e6470-9782-4db9-8e76-5268edd7ed6a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.219043 May 17 18:22:43.668029 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 241/537] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:43 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:22:44.131857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1d97b992-78c2-476d-b625-3e7ce2f48bb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:44.132478 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1d97b992-78c2-476d-b625-3e7ce2f48bb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:44.139401 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1d97b992-78c2-476d-b625-3e7ce2f48bb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:44.139851 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1d97b992-78c2-476d-b625-3e7ce2f48bb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:44.140619 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1d97b992-78c2-476d-b625-3e7ce2f48bb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:44.141057 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1d97b992-78c2-476d-b625-3e7ce2f48bb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:44.279319 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1d97b992-78c2-476d-b625-3e7ce2f48bb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:44.287210 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1d97b992-78c2-476d-b625-3e7ce2f48bb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.159398 May 17 18:22:44.287987 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 297/538] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:44 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:44.670178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5f3db2eb-3a9a-4af0-86ea-c2a88ac09186 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:44.671049 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5f3db2eb-3a9a-4af0-86ea-c2a88ac09186 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:44.677373 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5f3db2eb-3a9a-4af0-86ea-c2a88ac09186 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:44.677862 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5f3db2eb-3a9a-4af0-86ea-c2a88ac09186 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:44.678648 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5f3db2eb-3a9a-4af0-86ea-c2a88ac09186 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:44.679093 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5f3db2eb-3a9a-4af0-86ea-c2a88ac09186 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:44.750076 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7f679dbe-261a-445a-850d-10acccb65123 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:44.750814 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7f679dbe-261a-445a-850d-10acccb65123 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:44.757058 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7f679dbe-261a-445a-850d-10acccb65123 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:44.757629 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7f679dbe-261a-445a-850d-10acccb65123 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:44.758484 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7f679dbe-261a-445a-850d-10acccb65123 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:44.759004 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7f679dbe-261a-445a-850d-10acccb65123 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:44.864989 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5f3db2eb-3a9a-4af0-86ea-c2a88ac09186 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:44.874769 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5f3db2eb-3a9a-4af0-86ea-c2a88ac09186 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:44.876290 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5f3db2eb-3a9a-4af0-86ea-c2a88ac09186 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:44.878013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5f3db2eb-3a9a-4af0-86ea-c2a88ac09186 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.211757 May 17 18:22:44.880998 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 242/539] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:44 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:44.914838 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7f679dbe-261a-445a-850d-10acccb65123 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:44.923169 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7f679dbe-261a-445a-850d-10acccb65123 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.242900 May 17 18:22:44.923681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 298/540] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:44 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:22:45.304183 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-aa9e7499-ec90-4938-acfc-a508c1de0353 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:45.304860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-aa9e7499-ec90-4938-acfc-a508c1de0353 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:45.311982 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aa9e7499-ec90-4938-acfc-a508c1de0353 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:45.312503 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aa9e7499-ec90-4938-acfc-a508c1de0353 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:45.313303 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aa9e7499-ec90-4938-acfc-a508c1de0353 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:45.313829 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-aa9e7499-ec90-4938-acfc-a508c1de0353 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:45.444900 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-aa9e7499-ec90-4938-acfc-a508c1de0353 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:45.452748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-aa9e7499-ec90-4938-acfc-a508c1de0353 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.152514 May 17 18:22:45.453316 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 243/541] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:45 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:45.895637 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a30191d9-5b8f-4e27-882f-446dd7ce5158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:45.896273 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a30191d9-5b8f-4e27-882f-446dd7ce5158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:45.903214 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a30191d9-5b8f-4e27-882f-446dd7ce5158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:45.903675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a30191d9-5b8f-4e27-882f-446dd7ce5158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:45.904456 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a30191d9-5b8f-4e27-882f-446dd7ce5158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:45.904930 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a30191d9-5b8f-4e27-882f-446dd7ce5158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:45.940500 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b397ec0c-a5d9-4cff-a00c-e9d7197047df tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:45.941193 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b397ec0c-a5d9-4cff-a00c-e9d7197047df tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:45.947795 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b397ec0c-a5d9-4cff-a00c-e9d7197047df tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:45.948250 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b397ec0c-a5d9-4cff-a00c-e9d7197047df tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:45.949552 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b397ec0c-a5d9-4cff-a00c-e9d7197047df tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:45.950146 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b397ec0c-a5d9-4cff-a00c-e9d7197047df tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:46.094761 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a30191d9-5b8f-4e27-882f-446dd7ce5158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:46.106049 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a30191d9-5b8f-4e27-882f-446dd7ce5158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:46.108143 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a30191d9-5b8f-4e27-882f-446dd7ce5158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:46.109364 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a30191d9-5b8f-4e27-882f-446dd7ce5158 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.217638 May 17 18:22:46.109963 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 299/542] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:45 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:46.122178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b397ec0c-a5d9-4cff-a00c-e9d7197047df tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:46.129953 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b397ec0c-a5d9-4cff-a00c-e9d7197047df tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.193551 May 17 18:22:46.130518 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 244/543] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:45 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:22:46.470345 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-00b948e1-b84e-4990-8a10-00777594d1aa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:46.470965 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-00b948e1-b84e-4990-8a10-00777594d1aa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:46.477001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-00b948e1-b84e-4990-8a10-00777594d1aa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:46.477476 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-00b948e1-b84e-4990-8a10-00777594d1aa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:46.478296 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-00b948e1-b84e-4990-8a10-00777594d1aa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:46.478738 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-00b948e1-b84e-4990-8a10-00777594d1aa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:46.609088 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-00b948e1-b84e-4990-8a10-00777594d1aa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:46.616411 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-00b948e1-b84e-4990-8a10-00777594d1aa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.150174 May 17 18:22:46.616976 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 300/544] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:46 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:47.151922 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d956a377-6267-43a0-a263-bcacc144acc5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:47.152568 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d956a377-6267-43a0-a263-bcacc144acc5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:47.159331 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d956a377-6267-43a0-a263-bcacc144acc5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:47.160214 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d956a377-6267-43a0-a263-bcacc144acc5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:47.161185 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d956a377-6267-43a0-a263-bcacc144acc5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:47.161668 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d956a377-6267-43a0-a263-bcacc144acc5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:47.250318 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2267a898-406f-4f3e-a567-40225d21b045 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:47.250949 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2267a898-406f-4f3e-a567-40225d21b045 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:47.258204 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2267a898-406f-4f3e-a567-40225d21b045 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:47.258656 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2267a898-406f-4f3e-a567-40225d21b045 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:47.259611 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2267a898-406f-4f3e-a567-40225d21b045 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:47.260127 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2267a898-406f-4f3e-a567-40225d21b045 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:47.377158 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d956a377-6267-43a0-a263-bcacc144acc5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:47.394946 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d956a377-6267-43a0-a263-bcacc144acc5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.248456 May 17 18:22:47.397006 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 301/545] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:47 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:22:47.423346 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2267a898-406f-4f3e-a567-40225d21b045 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:47.431232 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2267a898-406f-4f3e-a567-40225d21b045 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:47.432728 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2267a898-406f-4f3e-a567-40225d21b045 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:47.433919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2267a898-406f-4f3e-a567-40225d21b045 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.310115 May 17 18:22:47.434469 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 245/546] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:47 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:47.635225 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-07d08e49-e342-4ede-b8be-7497cb6f153d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:47.636629 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-07d08e49-e342-4ede-b8be-7497cb6f153d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:47.645602 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-07d08e49-e342-4ede-b8be-7497cb6f153d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:47.645602 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-07d08e49-e342-4ede-b8be-7497cb6f153d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:47.645889 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-07d08e49-e342-4ede-b8be-7497cb6f153d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:47.646305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-07d08e49-e342-4ede-b8be-7497cb6f153d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:47.780019 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-07d08e49-e342-4ede-b8be-7497cb6f153d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:47.787391 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-07d08e49-e342-4ede-b8be-7497cb6f153d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.157742 May 17 18:22:47.793769 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 302/547] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:47 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:48.413851 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-949bdfee-bb9d-42a1-9517-4913247d8f02 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:48.414498 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-949bdfee-bb9d-42a1-9517-4913247d8f02 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:48.421387 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-949bdfee-bb9d-42a1-9517-4913247d8f02 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:48.421866 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-949bdfee-bb9d-42a1-9517-4913247d8f02 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:48.422634 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-949bdfee-bb9d-42a1-9517-4913247d8f02 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:48.423073 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-949bdfee-bb9d-42a1-9517-4913247d8f02 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:48.453291 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0eaaed5e-dfde-4e81-845e-06415ad4ebce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:48.454101 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0eaaed5e-dfde-4e81-845e-06415ad4ebce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:48.461381 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0eaaed5e-dfde-4e81-845e-06415ad4ebce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:48.461950 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0eaaed5e-dfde-4e81-845e-06415ad4ebce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:48.462810 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0eaaed5e-dfde-4e81-845e-06415ad4ebce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:48.463320 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0eaaed5e-dfde-4e81-845e-06415ad4ebce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:48.614322 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-949bdfee-bb9d-42a1-9517-4913247d8f02 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:48.622853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-949bdfee-bb9d-42a1-9517-4913247d8f02 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.212858 May 17 18:22:48.630142 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 246/548] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:48 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:22:48.649925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0eaaed5e-dfde-4e81-845e-06415ad4ebce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:48.658267 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0eaaed5e-dfde-4e81-845e-06415ad4ebce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:48.660208 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0eaaed5e-dfde-4e81-845e-06415ad4ebce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:48.661387 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0eaaed5e-dfde-4e81-845e-06415ad4ebce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.213154 May 17 18:22:48.661991 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 303/549] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:48 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:22:48.804101 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-63cad409-aaf8-4cac-8297-74526a2c740e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:48.804718 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-63cad409-aaf8-4cac-8297-74526a2c740e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:48.811139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63cad409-aaf8-4cac-8297-74526a2c740e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:48.811594 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63cad409-aaf8-4cac-8297-74526a2c740e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:48.812369 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63cad409-aaf8-4cac-8297-74526a2c740e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:48.812832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63cad409-aaf8-4cac-8297-74526a2c740e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:48.972317 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-63cad409-aaf8-4cac-8297-74526a2c740e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:48.979518 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-63cad409-aaf8-4cac-8297-74526a2c740e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.179290 May 17 18:22:48.980717 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 247/550] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:48 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:49.646416 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8889d426-f326-4d7e-8162-6f68b9cf8f4c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:49.647056 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-8889d426-f326-4d7e-8162-6f68b9cf8f4c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:49.653964 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8889d426-f326-4d7e-8162-6f68b9cf8f4c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:49.654412 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8889d426-f326-4d7e-8162-6f68b9cf8f4c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:49.655189 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8889d426-f326-4d7e-8162-6f68b9cf8f4c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:49.655621 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8889d426-f326-4d7e-8162-6f68b9cf8f4c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:49.680308 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e473dba0-ed12-4631-aeff-dde746bfa605 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:49.680932 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e473dba0-ed12-4631-aeff-dde746bfa605 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:49.694971 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e473dba0-ed12-4631-aeff-dde746bfa605 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:49.695514 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e473dba0-ed12-4631-aeff-dde746bfa605 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:49.696377 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e473dba0-ed12-4631-aeff-dde746bfa605 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:49.696827 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e473dba0-ed12-4631-aeff-dde746bfa605 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:49.865322 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8889d426-f326-4d7e-8162-6f68b9cf8f4c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:49.875421 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8889d426-f326-4d7e-8162-6f68b9cf8f4c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.232599 May 17 18:22:49.876480 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 304/551] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:49 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:49.881438 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e473dba0-ed12-4631-aeff-dde746bfa605 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:49.890438 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e473dba0-ed12-4631-aeff-dde746bfa605 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:49.891937 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e473dba0-ed12-4631-aeff-dde746bfa605 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:49.893109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e473dba0-ed12-4631-aeff-dde746bfa605 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.216803 May 17 18:22:49.893689 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 248/552] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:49 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:22:49.996120 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5d8e153d-97ad-42d0-94a7-04e50df118e6 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:49.996738 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5d8e153d-97ad-42d0-94a7-04e50df118e6 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:50.002905 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5d8e153d-97ad-42d0-94a7-04e50df118e6 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:50.003358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5d8e153d-97ad-42d0-94a7-04e50df118e6 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:50.004157 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5d8e153d-97ad-42d0-94a7-04e50df118e6 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:50.004582 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5d8e153d-97ad-42d0-94a7-04e50df118e6 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:50.134820 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5d8e153d-97ad-42d0-94a7-04e50df118e6 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:50.142798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5d8e153d-97ad-42d0-94a7-04e50df118e6 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.150501 May 17 18:22:50.143363 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 305/553] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:49 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:50.892043 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f813de79-a7b8-49cc-be67-edc1198daf99 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:50.892760 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f813de79-a7b8-49cc-be67-edc1198daf99 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:50.899324 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f813de79-a7b8-49cc-be67-edc1198daf99 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:50.899848 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f813de79-a7b8-49cc-be67-edc1198daf99 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:50.900700 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f813de79-a7b8-49cc-be67-edc1198daf99 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:50.901212 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f813de79-a7b8-49cc-be67-edc1198daf99 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:50.912394 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b02a5716-4a19-456d-ab24-e57982bedc23 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:50.912993 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b02a5716-4a19-456d-ab24-e57982bedc23 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:50.920069 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b02a5716-4a19-456d-ab24-e57982bedc23 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:50.920523 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b02a5716-4a19-456d-ab24-e57982bedc23 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:50.921347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b02a5716-4a19-456d-ab24-e57982bedc23 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:50.921941 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b02a5716-4a19-456d-ab24-e57982bedc23 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:51.104528 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f813de79-a7b8-49cc-be67-edc1198daf99 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:51.111665 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b02a5716-4a19-456d-ab24-e57982bedc23 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:51.112625 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f813de79-a7b8-49cc-be67-edc1198daf99 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.224354 May 17 18:22:51.113421 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 249/554] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:50 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:51.119678 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b02a5716-4a19-456d-ab24-e57982bedc23 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:51.121163 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b02a5716-4a19-456d-ab24-e57982bedc23 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:51.122422 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b02a5716-4a19-456d-ab24-e57982bedc23 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.214085 May 17 18:22:51.123142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 306/555] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:50 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:22:51.160405 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7a3ed3e2-5650-41e8-9d01-0cc888d2ae24 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:51.161028 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7a3ed3e2-5650-41e8-9d01-0cc888d2ae24 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:51.167063 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7a3ed3e2-5650-41e8-9d01-0cc888d2ae24 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:51.167521 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7a3ed3e2-5650-41e8-9d01-0cc888d2ae24 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:51.168400 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7a3ed3e2-5650-41e8-9d01-0cc888d2ae24 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:51.168842 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7a3ed3e2-5650-41e8-9d01-0cc888d2ae24 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:51.301426 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7a3ed3e2-5650-41e8-9d01-0cc888d2ae24 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:51.309423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7a3ed3e2-5650-41e8-9d01-0cc888d2ae24 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.152792 May 17 18:22:51.310315 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 250/556] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:51 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:52.128807 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2726dcc4-a0bf-4806-8dec-1e7ec145a302 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:52.129424 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2726dcc4-a0bf-4806-8dec-1e7ec145a302 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:52.136269 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2726dcc4-a0bf-4806-8dec-1e7ec145a302 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:52.136772 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2726dcc4-a0bf-4806-8dec-1e7ec145a302 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:52.137573 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2726dcc4-a0bf-4806-8dec-1e7ec145a302 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:52.138026 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2726dcc4-a0bf-4806-8dec-1e7ec145a302 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:52.139957 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8ac46523-9194-4539-a580-2086bd2ce3b4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:52.140598 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8ac46523-9194-4539-a580-2086bd2ce3b4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:52.146457 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ac46523-9194-4539-a580-2086bd2ce3b4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:52.146902 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ac46523-9194-4539-a580-2086bd2ce3b4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:52.147660 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ac46523-9194-4539-a580-2086bd2ce3b4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:52.148102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ac46523-9194-4539-a580-2086bd2ce3b4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:52.333185 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2726dcc4-a0bf-4806-8dec-1e7ec145a302 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:52.337231 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8ac46523-9194-4539-a580-2086bd2ce3b4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:52.340478 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2726dcc4-a0bf-4806-8dec-1e7ec145a302 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.215744 May 17 18:22:52.341053 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 307/557] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:52 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:52.345428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-686eee45-9361-4245-92cb-e79630e0c80e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:52.346111 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-686eee45-9361-4245-92cb-e79630e0c80e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:52.348979 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8ac46523-9194-4539-a580-2086bd2ce3b4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:52.350698 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8ac46523-9194-4539-a580-2086bd2ce3b4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:52.351733 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-686eee45-9361-4245-92cb-e79630e0c80e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:52.351968 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8ac46523-9194-4539-a580-2086bd2ce3b4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.215758 May 17 18:22:52.352175 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-686eee45-9361-4245-92cb-e79630e0c80e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:52.352807 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 251/558] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:52 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:22:52.352976 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-686eee45-9361-4245-92cb-e79630e0c80e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:52.353375 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-686eee45-9361-4245-92cb-e79630e0c80e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:52.481223 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-686eee45-9361-4245-92cb-e79630e0c80e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:52.488381 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-686eee45-9361-4245-92cb-e79630e0c80e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.146358 May 17 18:22:52.489158 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 308/559] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:52 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:53.358470 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9f8af55e-3dce-4003-8a62-a9663f5c7f68 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:53.359079 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-9f8af55e-3dce-4003-8a62-a9663f5c7f68 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:53.365453 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9f8af55e-3dce-4003-8a62-a9663f5c7f68 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:53.365932 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9f8af55e-3dce-4003-8a62-a9663f5c7f68 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:53.366699 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9f8af55e-3dce-4003-8a62-a9663f5c7f68 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:53.367137 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9f8af55e-3dce-4003-8a62-a9663f5c7f68 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:53.370381 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-98d62c12-42f5-40b6-9975-afc8895992bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:53.371504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-98d62c12-42f5-40b6-9975-afc8895992bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:53.377528 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-98d62c12-42f5-40b6-9975-afc8895992bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:53.377983 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-98d62c12-42f5-40b6-9975-afc8895992bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:53.378756 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-98d62c12-42f5-40b6-9975-afc8895992bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:53.379195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-98d62c12-42f5-40b6-9975-afc8895992bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:53.550338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-9f8af55e-3dce-4003-8a62-a9663f5c7f68 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:53.557818 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9f8af55e-3dce-4003-8a62-a9663f5c7f68 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.203231 May 17 18:22:53.559467 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 252/560] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:53 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:53.561840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-98d62c12-42f5-40b6-9975-afc8895992bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:53.564441 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0a1d1ee8-c0de-48c8-ae15-7c78b395f1a7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:53.565069 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0a1d1ee8-c0de-48c8-ae15-7c78b395f1a7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:53.570267 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-98d62c12-42f5-40b6-9975-afc8895992bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:53.570869 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0a1d1ee8-c0de-48c8-ae15-7c78b395f1a7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:53.571326 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0a1d1ee8-c0de-48c8-ae15-7c78b395f1a7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:53.571769 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-98d62c12-42f5-40b6-9975-afc8895992bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:53.572109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0a1d1ee8-c0de-48c8-ae15-7c78b395f1a7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:53.572555 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0a1d1ee8-c0de-48c8-ae15-7c78b395f1a7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:53.572910 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-98d62c12-42f5-40b6-9975-afc8895992bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.206303 May 17 18:22:53.573485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 309/561] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:53 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:22:53.699668 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0a1d1ee8-c0de-48c8-ae15-7c78b395f1a7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:53.706857 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0a1d1ee8-c0de-48c8-ae15-7c78b395f1a7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.146363 May 17 18:22:53.707415 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 253/562] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:53 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:54.575817 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5483a495-8a2b-4363-9a4e-47961453a041 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:54.576433 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5483a495-8a2b-4363-9a4e-47961453a041 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:54.582989 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5483a495-8a2b-4363-9a4e-47961453a041 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:54.583440 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5483a495-8a2b-4363-9a4e-47961453a041 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:54.584199 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5483a495-8a2b-4363-9a4e-47961453a041 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:54.584632 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5483a495-8a2b-4363-9a4e-47961453a041 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:54.591877 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-76f37394-69e3-4d1b-801b-d4c9f1fd75f3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:54.592482 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-76f37394-69e3-4d1b-801b-d4c9f1fd75f3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:54.598518 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76f37394-69e3-4d1b-801b-d4c9f1fd75f3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:54.598971 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76f37394-69e3-4d1b-801b-d4c9f1fd75f3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:54.599744 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76f37394-69e3-4d1b-801b-d4c9f1fd75f3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:54.600178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-76f37394-69e3-4d1b-801b-d4c9f1fd75f3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:54.763926 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5483a495-8a2b-4363-9a4e-47961453a041 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:54.771852 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5483a495-8a2b-4363-9a4e-47961453a041 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.200736 May 17 18:22:54.780153 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 310/563] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:54 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:54.780153 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cd8659e5-a924-42cf-b333-f513eda2a91a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:54.780153 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cd8659e5-a924-42cf-b333-f513eda2a91a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:54.784732 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd8659e5-a924-42cf-b333-f513eda2a91a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:54.785185 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd8659e5-a924-42cf-b333-f513eda2a91a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:54.785984 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd8659e5-a924-42cf-b333-f513eda2a91a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:54.786419 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd8659e5-a924-42cf-b333-f513eda2a91a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:54.795284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-76f37394-69e3-4d1b-801b-d4c9f1fd75f3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:54.803842 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-76f37394-69e3-4d1b-801b-d4c9f1fd75f3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:54.805488 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-76f37394-69e3-4d1b-801b-d4c9f1fd75f3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:54.806742 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-76f37394-69e3-4d1b-801b-d4c9f1fd75f3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.219352 May 17 18:22:54.807569 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 254/564] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:54 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:22:54.932327 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cd8659e5-a924-42cf-b333-f513eda2a91a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:54.939776 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cd8659e5-a924-42cf-b333-f513eda2a91a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.165907 May 17 18:22:54.940356 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 311/565] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:54 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:55.345500 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-f5953e22-c4d7-4412-8ef3-153bce374dc4 req-511c14fd-90d8-4861-ae6b-c85baac1f647 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e42d88-56d2-431d-9b8a-874306f6895d", "tag": "cc5efd46-7563-4b9a-9d0d-a824d9fd3faf"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:55.372120 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f5953e22-c4d7-4412-8ef3-153bce374dc4 req-511c14fd-90d8-4861-ae6b-c85baac1f647 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:55.372719 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f5953e22-c4d7-4412-8ef3-153bce374dc4 req-511c14fd-90d8-4861-ae6b-c85baac1f647 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:55.390110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-f5953e22-c4d7-4412-8ef3-153bce374dc4 req-511c14fd-90d8-4861-ae6b-c85baac1f647 service nova] Creating event network-changed:cc5efd46-7563-4b9a-9d0d-a824d9fd3faf for instance d4e42d88-56d2-431d-9b8a-874306f6895d on hv-cinder-83736 May 17 18:22:55.395899 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-f5953e22-c4d7-4412-8ef3-153bce374dc4 req-511c14fd-90d8-4861-ae6b-c85baac1f647 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054965 May 17 18:22:55.397679 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 255/566] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:22:55.789483 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-360fc040-d34b-4c46-aa7b-aab4059e2bd6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:55.790120 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-360fc040-d34b-4c46-aa7b-aab4059e2bd6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:55.796975 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-360fc040-d34b-4c46-aa7b-aab4059e2bd6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:55.797437 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-360fc040-d34b-4c46-aa7b-aab4059e2bd6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:55.798242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-360fc040-d34b-4c46-aa7b-aab4059e2bd6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:55.798691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-360fc040-d34b-4c46-aa7b-aab4059e2bd6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:55.825135 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-dc0aafc3-40a8-4421-80e0-88f112aa0488 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:55.826096 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-dc0aafc3-40a8-4421-80e0-88f112aa0488 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:55.832774 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc0aafc3-40a8-4421-80e0-88f112aa0488 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:55.833227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc0aafc3-40a8-4421-80e0-88f112aa0488 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:55.834045 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc0aafc3-40a8-4421-80e0-88f112aa0488 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:55.834521 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dc0aafc3-40a8-4421-80e0-88f112aa0488 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:55.976271 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-360fc040-d34b-4c46-aa7b-aab4059e2bd6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:55.984060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-360fc040-d34b-4c46-aa7b-aab4059e2bd6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.198408 May 17 18:22:55.984638 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 312/567] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:55 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:55.989045 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1472082a-d6ce-4011-bc7c-a987c6a0bb84 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:55.989750 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1472082a-d6ce-4011-bc7c-a987c6a0bb84 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:55.995456 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1472082a-d6ce-4011-bc7c-a987c6a0bb84 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:55.996555 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1472082a-d6ce-4011-bc7c-a987c6a0bb84 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:55.997335 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1472082a-d6ce-4011-bc7c-a987c6a0bb84 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:55.997800 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1472082a-d6ce-4011-bc7c-a987c6a0bb84 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:56.003053 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dc0aafc3-40a8-4421-80e0-88f112aa0488 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:56.010840 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dc0aafc3-40a8-4421-80e0-88f112aa0488 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:56.012354 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dc0aafc3-40a8-4421-80e0-88f112aa0488 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:56.013535 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-dc0aafc3-40a8-4421-80e0-88f112aa0488 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.193249 May 17 18:22:56.014101 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 256/568] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:55 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:22:56.120673 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1472082a-d6ce-4011-bc7c-a987c6a0bb84 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:56.128395 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1472082a-d6ce-4011-bc7c-a987c6a0bb84 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.142825 May 17 18:22:56.128964 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 313/569] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:55 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:57.000520 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1e559200-69d0-481e-b287-167699592095 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:57.001139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1e559200-69d0-481e-b287-167699592095 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:57.007687 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e559200-69d0-481e-b287-167699592095 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:57.008152 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e559200-69d0-481e-b287-167699592095 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:57.008924 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e559200-69d0-481e-b287-167699592095 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:57.009366 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e559200-69d0-481e-b287-167699592095 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:57.031169 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-01e31512-0ecb-4c37-8e2c-ad639dae22ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:57.031786 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-01e31512-0ecb-4c37-8e2c-ad639dae22ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:57.038334 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-01e31512-0ecb-4c37-8e2c-ad639dae22ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:57.038791 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-01e31512-0ecb-4c37-8e2c-ad639dae22ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:57.039568 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-01e31512-0ecb-4c37-8e2c-ad639dae22ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:57.040009 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-01e31512-0ecb-4c37-8e2c-ad639dae22ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:57.190453 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1e559200-69d0-481e-b287-167699592095 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:57.198536 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1e559200-69d0-481e-b287-167699592095 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.201776 May 17 18:22:57.200021 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 257/570] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:56 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:57.204965 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7b64a41b-4941-4dcf-be4c-8ad1de3a2860 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:57.205701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7b64a41b-4941-4dcf-be4c-8ad1de3a2860 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:57.211844 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b64a41b-4941-4dcf-be4c-8ad1de3a2860 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:57.212371 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b64a41b-4941-4dcf-be4c-8ad1de3a2860 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:57.213215 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b64a41b-4941-4dcf-be4c-8ad1de3a2860 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:57.213694 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b64a41b-4941-4dcf-be4c-8ad1de3a2860 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:57.216016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-01e31512-0ecb-4c37-8e2c-ad639dae22ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:57.223823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-01e31512-0ecb-4c37-8e2c-ad639dae22ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:57.225335 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-01e31512-0ecb-4c37-8e2c-ad639dae22ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:57.226541 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-01e31512-0ecb-4c37-8e2c-ad639dae22ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.199328 May 17 18:22:57.227097 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 314/571] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:57 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:22:57.338803 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7b64a41b-4941-4dcf-be4c-8ad1de3a2860 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:57.346001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7b64a41b-4941-4dcf-be4c-8ad1de3a2860 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.144851 May 17 18:22:57.346563 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 258/572] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:57 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:58.218441 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-882eeb78-dcc9-47f5-bcb2-e16356fcc638 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:58.219056 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-882eeb78-dcc9-47f5-bcb2-e16356fcc638 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:58.225353 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-882eeb78-dcc9-47f5-bcb2-e16356fcc638 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:58.225832 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-882eeb78-dcc9-47f5-bcb2-e16356fcc638 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:58.226606 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-882eeb78-dcc9-47f5-bcb2-e16356fcc638 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:58.227046 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-882eeb78-dcc9-47f5-bcb2-e16356fcc638 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:58.244531 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-af429bc8-0c40-4784-b410-c76317c51a1c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:58.245139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-af429bc8-0c40-4784-b410-c76317c51a1c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:58.251549 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-af429bc8-0c40-4784-b410-c76317c51a1c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:58.251995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-af429bc8-0c40-4784-b410-c76317c51a1c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:58.252758 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-af429bc8-0c40-4784-b410-c76317c51a1c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:58.253191 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-af429bc8-0c40-4784-b410-c76317c51a1c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:58.419397 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-882eeb78-dcc9-47f5-bcb2-e16356fcc638 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:58.427136 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-882eeb78-dcc9-47f5-bcb2-e16356fcc638 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.213418 May 17 18:22:58.427919 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 315/573] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:58 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:58.432267 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-462a348d-ac78-4ea5-b0b1-62568c248f67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:58.432874 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-462a348d-ac78-4ea5-b0b1-62568c248f67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:58.438255 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-af429bc8-0c40-4784-b410-c76317c51a1c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:58.439008 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-462a348d-ac78-4ea5-b0b1-62568c248f67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:58.439464 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-462a348d-ac78-4ea5-b0b1-62568c248f67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:58.440248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-462a348d-ac78-4ea5-b0b1-62568c248f67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:58.440690 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-462a348d-ac78-4ea5-b0b1-62568c248f67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:58.448643 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-af429bc8-0c40-4784-b410-c76317c51a1c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:58.451843 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-af429bc8-0c40-4784-b410-c76317c51a1c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:58.453606 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-af429bc8-0c40-4784-b410-c76317c51a1c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.212619 May 17 18:22:58.454518 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 259/574] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:58 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:22:58.568540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-462a348d-ac78-4ea5-b0b1-62568c248f67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:58.576799 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-462a348d-ac78-4ea5-b0b1-62568c248f67 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.148137 May 17 18:22:58.577367 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 316/575] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:58 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:58.876961 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-d2d206c3-97c2-4fee-96da-150ecd15a854 req-9287a500-d3cd-4658-9b4c-d9331f2bbdf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e", "name": "network-vif-plugged", "status": "completed", "tag": "06e106bb-68fb-497b-a3fb-dae45c0c334c"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:22:58.884805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-d2d206c3-97c2-4fee-96da-150ecd15a854 req-9287a500-d3cd-4658-9b4c-d9331f2bbdf1 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:58.885256 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-d2d206c3-97c2-4fee-96da-150ecd15a854 req-9287a500-d3cd-4658-9b4c-d9331f2bbdf1 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:58.896000 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-d2d206c3-97c2-4fee-96da-150ecd15a854 req-9287a500-d3cd-4658-9b4c-d9331f2bbdf1 service nova] Creating event network-vif-plugged:06e106bb-68fb-497b-a3fb-dae45c0c334c for instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e on hv-cinder-83736 May 17 18:22:58.901050 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-d2d206c3-97c2-4fee-96da-150ecd15a854 req-9287a500-d3cd-4658-9b4c-d9331f2bbdf1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027750 May 17 18:22:58.901691 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 260/576] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:22:59.444110 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a32d666d-2b3c-41c5-a25e-dda57c28cb47 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:59.444725 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a32d666d-2b3c-41c5-a25e-dda57c28cb47 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:59.451259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a32d666d-2b3c-41c5-a25e-dda57c28cb47 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:59.451702 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a32d666d-2b3c-41c5-a25e-dda57c28cb47 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:59.452458 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a32d666d-2b3c-41c5-a25e-dda57c28cb47 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:59.452894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a32d666d-2b3c-41c5-a25e-dda57c28cb47 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:59.472889 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-64050ef6-5757-4160-9ef1-53d4d958f319 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:59.473639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-64050ef6-5757-4160-9ef1-53d4d958f319 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:59.479724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-64050ef6-5757-4160-9ef1-53d4d958f319 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:59.480767 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-64050ef6-5757-4160-9ef1-53d4d958f319 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:59.481585 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-64050ef6-5757-4160-9ef1-53d4d958f319 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:59.482034 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-64050ef6-5757-4160-9ef1-53d4d958f319 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:59.649757 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a32d666d-2b3c-41c5-a25e-dda57c28cb47 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:59.661132 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-64050ef6-5757-4160-9ef1-53d4d958f319 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:59.662080 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a32d666d-2b3c-41c5-a25e-dda57c28cb47 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.221795 May 17 18:22:59.662739 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 317/577] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:59 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:22:59.667382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-73d572cb-3072-4eb4-9b1c-ad91d6281bf2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:22:59.668062 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-73d572cb-3072-4eb4-9b1c-ad91d6281bf2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:22:59.671101 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-64050ef6-5757-4160-9ef1-53d4d958f319 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:59.672832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-64050ef6-5757-4160-9ef1-53d4d958f319 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:59.674128 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-64050ef6-5757-4160-9ef1-53d4d958f319 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1745 microversion: 2.20 time: 0.205910 May 17 18:22:59.674256 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-73d572cb-3072-4eb4-9b1c-ad91d6281bf2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:59.674723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-73d572cb-3072-4eb4-9b1c-ad91d6281bf2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:59.685098 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 261/578] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:22:59 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1745 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:22:59.685270 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-73d572cb-3072-4eb4-9b1c-ad91d6281bf2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:22:59.685270 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-73d572cb-3072-4eb4-9b1c-ad91d6281bf2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:22:59.803994 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-73d572cb-3072-4eb4-9b1c-ad91d6281bf2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:22:59.811771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-73d572cb-3072-4eb4-9b1c-ad91d6281bf2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.148018 May 17 18:22:59.812333 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 318/579] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:22:59 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:00.679055 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d88d10ea-caa4-4df9-b9b1-4b698284f692 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:00.679678 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d88d10ea-caa4-4df9-b9b1-4b698284f692 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:00.687169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d88d10ea-caa4-4df9-b9b1-4b698284f692 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:00.687618 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d88d10ea-caa4-4df9-b9b1-4b698284f692 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:00.688398 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d88d10ea-caa4-4df9-b9b1-4b698284f692 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:00.688837 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d88d10ea-caa4-4df9-b9b1-4b698284f692 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:00.692083 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fd20d6a2-d28d-42d1-98ee-9077adb1dce5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:00.692700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fd20d6a2-d28d-42d1-98ee-9077adb1dce5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:00.699933 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd20d6a2-d28d-42d1-98ee-9077adb1dce5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:00.700391 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd20d6a2-d28d-42d1-98ee-9077adb1dce5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:00.701171 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd20d6a2-d28d-42d1-98ee-9077adb1dce5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:00.701640 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fd20d6a2-d28d-42d1-98ee-9077adb1dce5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:00.883283 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d88d10ea-caa4-4df9-b9b1-4b698284f692 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:00.885684 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fd20d6a2-d28d-42d1-98ee-9077adb1dce5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:00.891526 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d88d10ea-caa4-4df9-b9b1-4b698284f692 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.216225 May 17 18:23:00.901008 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 262/580] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:00 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:00.901229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fd20d6a2-d28d-42d1-98ee-9077adb1dce5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:00.901358 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-af5677e6-04c1-424e-97cb-08265fd9dd69 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:00.901491 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fd20d6a2-d28d-42d1-98ee-9077adb1dce5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:00.901618 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-af5677e6-04c1-424e-97cb-08265fd9dd69 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:00.901722 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fd20d6a2-d28d-42d1-98ee-9077adb1dce5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1745 microversion: 2.20 time: 0.210564 May 17 18:23:00.902306 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 319/581] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:00 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1745 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:23:00.906150 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-af5677e6-04c1-424e-97cb-08265fd9dd69 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:00.906612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-af5677e6-04c1-424e-97cb-08265fd9dd69 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:00.907401 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-af5677e6-04c1-424e-97cb-08265fd9dd69 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:00.907846 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-af5677e6-04c1-424e-97cb-08265fd9dd69 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:00.990475 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-b3f517b7-cb13-40ea-9263-7e8433b22db1 req-a5e0ea2c-310e-4f2d-930f-0dfa49e44286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc177fc2-a93f-4490-8e44-0774f508720a", "name": "network-vif-plugged", "status": "completed", "tag": "de8a891f-5a42-49e2-b6a3-15f94c53ec66"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:00.999740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-b3f517b7-cb13-40ea-9263-7e8433b22db1 req-a5e0ea2c-310e-4f2d-930f-0dfa49e44286 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:01.000191 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-b3f517b7-cb13-40ea-9263-7e8433b22db1 req-a5e0ea2c-310e-4f2d-930f-0dfa49e44286 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:01.012730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-b3f517b7-cb13-40ea-9263-7e8433b22db1 req-a5e0ea2c-310e-4f2d-930f-0dfa49e44286 service nova] Creating event network-vif-plugged:de8a891f-5a42-49e2-b6a3-15f94c53ec66 for instance cc177fc2-a93f-4490-8e44-0774f508720a on hv-cinder-83736 May 17 18:23:01.017755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-b3f517b7-cb13-40ea-9263-7e8433b22db1 req-a5e0ea2c-310e-4f2d-930f-0dfa49e44286 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031078 May 17 18:23:01.018351 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 320/582] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:23:01.041237 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-af5677e6-04c1-424e-97cb-08265fd9dd69 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:01.049125 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-af5677e6-04c1-424e-97cb-08265fd9dd69 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.156013 May 17 18:23:01.049790 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 263/583] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:00 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:01.466106 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-67058570-2ec9-4c0c-8d29-97976784d075 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c3070a6-2860-419f-b66a-26955e1758ad"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:01.467313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-67058570-2ec9-4c0c-8d29-97976784d075 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:01.473594 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-67058570-2ec9-4c0c-8d29-97976784d075 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:01.474094 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-67058570-2ec9-4c0c-8d29-97976784d075 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:01.474865 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-67058570-2ec9-4c0c-8d29-97976784d075 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:01.475340 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-67058570-2ec9-4c0c-8d29-97976784d075 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:01.785946 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-67058570-2ec9-4c0c-8d29-97976784d075 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "POST /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.417310 May 17 18:23:01.794690 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 321/584] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:23:01 2022] POST /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments => generated 194 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:23:01.908623 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-091206f0-3d5b-40e9-8b60-31fedf1e838a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:01.909334 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-091206f0-3d5b-40e9-8b60-31fedf1e838a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:01.918207 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-091206f0-3d5b-40e9-8b60-31fedf1e838a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:01.918930 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-091206f0-3d5b-40e9-8b60-31fedf1e838a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:01.920567 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-091206f0-3d5b-40e9-8b60-31fedf1e838a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:01.920773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d073ffdb-2a1d-4a3c-8928-5702990806ba tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:01.921423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-091206f0-3d5b-40e9-8b60-31fedf1e838a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:01.921807 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d073ffdb-2a1d-4a3c-8928-5702990806ba tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:01.931139 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d073ffdb-2a1d-4a3c-8928-5702990806ba tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:01.931950 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d073ffdb-2a1d-4a3c-8928-5702990806ba tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:01.932773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d073ffdb-2a1d-4a3c-8928-5702990806ba tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:01.933838 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d073ffdb-2a1d-4a3c-8928-5702990806ba tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:02.112706 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-091206f0-3d5b-40e9-8b60-31fedf1e838a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:02.121356 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-091206f0-3d5b-40e9-8b60-31fedf1e838a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.216208 May 17 18:23:02.121969 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 264/585] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:01 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:02.123306 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d073ffdb-2a1d-4a3c-8928-5702990806ba tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:02.126841 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e97875f5-6520-4585-9f81-c8911499e376 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:02.127649 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e97875f5-6520-4585-9f81-c8911499e376 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:02.131370 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d073ffdb-2a1d-4a3c-8928-5702990806ba tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:02.132962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d073ffdb-2a1d-4a3c-8928-5702990806ba tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:02.133812 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e97875f5-6520-4585-9f81-c8911499e376 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:02.134279 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d073ffdb-2a1d-4a3c-8928-5702990806ba tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1745 microversion: 2.20 time: 0.222020 May 17 18:23:02.134400 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e97875f5-6520-4585-9f81-c8911499e376 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:02.134834 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 322/586] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:01 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1745 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:02.135161 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e97875f5-6520-4585-9f81-c8911499e376 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:02.135639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e97875f5-6520-4585-9f81-c8911499e376 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:02.263756 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e97875f5-6520-4585-9f81-c8911499e376 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:02.271962 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e97875f5-6520-4585-9f81-c8911499e376 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.148983 May 17 18:23:02.272533 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 265/587] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:02 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:03.137274 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2bc83c28-e921-4c35-b8bf-bd0862aac583 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:03.137929 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2bc83c28-e921-4c35-b8bf-bd0862aac583 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:03.144314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2bc83c28-e921-4c35-b8bf-bd0862aac583 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:03.144766 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2bc83c28-e921-4c35-b8bf-bd0862aac583 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:03.145572 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2bc83c28-e921-4c35-b8bf-bd0862aac583 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:03.146016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2bc83c28-e921-4c35-b8bf-bd0862aac583 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:03.154347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6a221ac2-fdbc-491d-a67a-9b5fdf9b0c36 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:03.154986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6a221ac2-fdbc-491d-a67a-9b5fdf9b0c36 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:03.161332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6a221ac2-fdbc-491d-a67a-9b5fdf9b0c36 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:03.162028 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6a221ac2-fdbc-491d-a67a-9b5fdf9b0c36 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:03.162864 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6a221ac2-fdbc-491d-a67a-9b5fdf9b0c36 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:03.163330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6a221ac2-fdbc-491d-a67a-9b5fdf9b0c36 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:03.342532 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2bc83c28-e921-4c35-b8bf-bd0862aac583 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:03.349352 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6a221ac2-fdbc-491d-a67a-9b5fdf9b0c36 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:03.350236 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2bc83c28-e921-4c35-b8bf-bd0862aac583 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1368 microversion: 2.1 time: 0.216739 May 17 18:23:03.350823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 323/588] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:03 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:03.355491 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-940eb878-ef0b-4671-b16e-eae995963d7d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:03.356106 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-940eb878-ef0b-4671-b16e-eae995963d7d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:03.357991 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6a221ac2-fdbc-491d-a67a-9b5fdf9b0c36 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:03.359794 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6a221ac2-fdbc-491d-a67a-9b5fdf9b0c36 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:03.360984 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6a221ac2-fdbc-491d-a67a-9b5fdf9b0c36 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1745 microversion: 2.20 time: 0.211871 May 17 18:23:03.361653 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 266/589] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:03 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1745 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:03.364422 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-940eb878-ef0b-4671-b16e-eae995963d7d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:03.364883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-940eb878-ef0b-4671-b16e-eae995963d7d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:03.365706 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-940eb878-ef0b-4671-b16e-eae995963d7d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:03.366413 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-940eb878-ef0b-4671-b16e-eae995963d7d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:03.489967 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-940eb878-ef0b-4671-b16e-eae995963d7d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:03.497175 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-940eb878-ef0b-4671-b16e-eae995963d7d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.145405 May 17 18:23:03.497768 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 324/590] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:03 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:04.366873 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5919803b-8c5d-4ed9-8831-5d42e320a91c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:04.367496 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5919803b-8c5d-4ed9-8831-5d42e320a91c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:04.374613 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5919803b-8c5d-4ed9-8831-5d42e320a91c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:04.375076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5919803b-8c5d-4ed9-8831-5d42e320a91c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:04.375854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5919803b-8c5d-4ed9-8831-5d42e320a91c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:04.376305 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5919803b-8c5d-4ed9-8831-5d42e320a91c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:04.378268 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9b0bea05-bf2d-4582-a7d1-df0a6a8ace13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:04.378882 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9b0bea05-bf2d-4582-a7d1-df0a6a8ace13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:04.385184 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9b0bea05-bf2d-4582-a7d1-df0a6a8ace13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:04.385685 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9b0bea05-bf2d-4582-a7d1-df0a6a8ace13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:04.386460 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9b0bea05-bf2d-4582-a7d1-df0a6a8ace13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:04.386902 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9b0bea05-bf2d-4582-a7d1-df0a6a8ace13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:04.793551 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5919803b-8c5d-4ed9-8831-5d42e320a91c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:04.796315 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9b0bea05-bf2d-4582-a7d1-df0a6a8ace13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:04.800880 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5919803b-8c5d-4ed9-8831-5d42e320a91c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1557 microversion: 2.1 time: 0.437764 May 17 18:23:04.801493 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 267/591] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:04 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1557 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:04.805907 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4fd72fcf-f910-481c-b5e1-7966b78e44bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:04.806587 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4fd72fcf-f910-481c-b5e1-7966b78e44bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:04.808337 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9b0bea05-bf2d-4582-a7d1-df0a6a8ace13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:04.809890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9b0bea05-bf2d-4582-a7d1-df0a6a8ace13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:04.811048 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9b0bea05-bf2d-4582-a7d1-df0a6a8ace13 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1745 microversion: 2.20 time: 0.436666 May 17 18:23:04.811592 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 325/592] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:04 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1745 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:23:04.812577 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fd72fcf-f910-481c-b5e1-7966b78e44bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:04.813032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fd72fcf-f910-481c-b5e1-7966b78e44bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:04.813837 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fd72fcf-f910-481c-b5e1-7966b78e44bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:04.814277 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fd72fcf-f910-481c-b5e1-7966b78e44bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:04.816707 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cf7c6098-a934-469f-ae28-ed67958645dc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:04.817194 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cf7c6098-a934-469f-ae28-ed67958645dc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:04.822909 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf7c6098-a934-469f-ae28-ed67958645dc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:04.823355 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf7c6098-a934-469f-ae28-ed67958645dc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:04.825001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf7c6098-a934-469f-ae28-ed67958645dc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:04.825436 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf7c6098-a934-469f-ae28-ed67958645dc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:04.932146 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cf7c6098-a934-469f-ae28-ed67958645dc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119012 May 17 18:23:04.932741 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 326/593] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 17 18:23:04 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:23:04.977851 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4fd72fcf-f910-481c-b5e1-7966b78e44bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:04.985753 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4fd72fcf-f910-481c-b5e1-7966b78e44bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.183142 May 17 18:23:04.986608 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 268/594] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:04 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:05.289447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-de17111c-f349-4cb0-a5b6-f892a512ff42 req-996d50aa-c116-44e7-98d2-79e185fa1133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e42d88-56d2-431d-9b8a-874306f6895d", "name": "network-vif-plugged", "status": "completed", "tag": "cc5efd46-7563-4b9a-9d0d-a824d9fd3faf"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:05.298803 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-de17111c-f349-4cb0-a5b6-f892a512ff42 req-996d50aa-c116-44e7-98d2-79e185fa1133 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:05.299274 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-de17111c-f349-4cb0-a5b6-f892a512ff42 req-996d50aa-c116-44e7-98d2-79e185fa1133 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:05.312893 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-de17111c-f349-4cb0-a5b6-f892a512ff42 req-996d50aa-c116-44e7-98d2-79e185fa1133 service nova] Creating event network-vif-plugged:cc5efd46-7563-4b9a-9d0d-a824d9fd3faf for instance d4e42d88-56d2-431d-9b8a-874306f6895d on hv-cinder-83736 May 17 18:23:05.318100 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-de17111c-f349-4cb0-a5b6-f892a512ff42 req-996d50aa-c116-44e7-98d2-79e185fa1133 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032497 May 17 18:23:05.318898 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 327/595] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:23:05.829134 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d26e0946-5d9f-4851-8ba1-73438864ea0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:05.834054 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d26e0946-5d9f-4851-8ba1-73438864ea0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:05.840522 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d26e0946-5d9f-4851-8ba1-73438864ea0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:05.841026 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d26e0946-5d9f-4851-8ba1-73438864ea0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:05.841832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d26e0946-5d9f-4851-8ba1-73438864ea0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:05.842269 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d26e0946-5d9f-4851-8ba1-73438864ea0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:05.973158 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d26e0946-5d9f-4851-8ba1-73438864ea0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:05.981701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d26e0946-5d9f-4851-8ba1-73438864ea0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:05.983281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d26e0946-5d9f-4851-8ba1-73438864ea0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:05.984449 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d26e0946-5d9f-4851-8ba1-73438864ea0f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1745 microversion: 2.20 time: 0.159262 May 17 18:23:05.985004 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 269/596] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:05 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:06.003462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4522c837-cb01-4ee7-b44b-21fb02db48ba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:06.004240 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4522c837-cb01-4ee7-b44b-21fb02db48ba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:06.010644 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4522c837-cb01-4ee7-b44b-21fb02db48ba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:06.011150 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4522c837-cb01-4ee7-b44b-21fb02db48ba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:06.012138 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4522c837-cb01-4ee7-b44b-21fb02db48ba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:06.012261 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4522c837-cb01-4ee7-b44b-21fb02db48ba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:06.154924 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4522c837-cb01-4ee7-b44b-21fb02db48ba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:06.162529 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4522c837-cb01-4ee7-b44b-21fb02db48ba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.163617 May 17 18:23:06.163097 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 328/597] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:05 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:06.170979 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-e18797a0-ff60-48b4-a382-06caced36cc7 req-d5687078-f686-4171-b354-c78422cbae18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc177fc2-a93f-4490-8e44-0774f508720a", "tag": "de8a891f-5a42-49e2-b6a3-15f94c53ec66"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:06.179226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-e18797a0-ff60-48b4-a382-06caced36cc7 req-d5687078-f686-4171-b354-c78422cbae18 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:06.179678 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-e18797a0-ff60-48b4-a382-06caced36cc7 req-d5687078-f686-4171-b354-c78422cbae18 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:06.198356 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-e18797a0-ff60-48b4-a382-06caced36cc7 req-d5687078-f686-4171-b354-c78422cbae18 service nova] Creating event network-changed:de8a891f-5a42-49e2-b6a3-15f94c53ec66 for instance cc177fc2-a93f-4490-8e44-0774f508720a on hv-cinder-83736 May 17 18:23:06.205018 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-e18797a0-ff60-48b4-a382-06caced36cc7 req-d5687078-f686-4171-b354-c78422cbae18 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093680 May 17 18:23:06.206095 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 270/598] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:23:07.002594 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-42f5bcc7-4a89-4fa4-ad58-f557991ae59d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:07.003205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-42f5bcc7-4a89-4fa4-ad58-f557991ae59d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:07.009480 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-42f5bcc7-4a89-4fa4-ad58-f557991ae59d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:07.010037 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-42f5bcc7-4a89-4fa4-ad58-f557991ae59d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:07.010691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-42f5bcc7-4a89-4fa4-ad58-f557991ae59d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:07.011763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-42f5bcc7-4a89-4fa4-ad58-f557991ae59d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:07.158167 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-42f5bcc7-4a89-4fa4-ad58-f557991ae59d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:07.166194 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-42f5bcc7-4a89-4fa4-ad58-f557991ae59d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:07.168244 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-42f5bcc7-4a89-4fa4-ad58-f557991ae59d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:07.169411 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-42f5bcc7-4a89-4fa4-ad58-f557991ae59d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1745 microversion: 2.20 time: 0.170803 May 17 18:23:07.170008 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 329/599] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:06 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:23:07.180928 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ebfc0f22-4314-4f6c-9f49-2fe04eaefbe3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:07.181594 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ebfc0f22-4314-4f6c-9f49-2fe04eaefbe3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:07.188483 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ebfc0f22-4314-4f6c-9f49-2fe04eaefbe3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:07.189013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ebfc0f22-4314-4f6c-9f49-2fe04eaefbe3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:07.189902 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ebfc0f22-4314-4f6c-9f49-2fe04eaefbe3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:07.190433 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ebfc0f22-4314-4f6c-9f49-2fe04eaefbe3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:07.321166 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ebfc0f22-4314-4f6c-9f49-2fe04eaefbe3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:07.328809 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ebfc0f22-4314-4f6c-9f49-2fe04eaefbe3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1357 microversion: 2.1 time: 0.152537 May 17 18:23:07.329384 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 271/600] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:07 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:08.187935 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8214fada-32a7-40ed-b66d-35c58c2905d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:08.188552 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-8214fada-32a7-40ed-b66d-35c58c2905d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:08.195003 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8214fada-32a7-40ed-b66d-35c58c2905d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:08.195455 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8214fada-32a7-40ed-b66d-35c58c2905d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:08.196228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8214fada-32a7-40ed-b66d-35c58c2905d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:08.196666 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8214fada-32a7-40ed-b66d-35c58c2905d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:08.321194 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8214fada-32a7-40ed-b66d-35c58c2905d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:08.329183 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8214fada-32a7-40ed-b66d-35c58c2905d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:08.330735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8214fada-32a7-40ed-b66d-35c58c2905d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:08.331893 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8214fada-32a7-40ed-b66d-35c58c2905d0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1745 microversion: 2.20 time: 0.147975 May 17 18:23:08.332466 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 330/601] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:08 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1745 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:08.345971 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5fc1ecaa-4130-41a2-a8c7-f0869189d1bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:08.346594 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5fc1ecaa-4130-41a2-a8c7-f0869189d1bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:08.352910 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5fc1ecaa-4130-41a2-a8c7-f0869189d1bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:08.353368 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5fc1ecaa-4130-41a2-a8c7-f0869189d1bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:08.354183 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5fc1ecaa-4130-41a2-a8c7-f0869189d1bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:08.354673 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5fc1ecaa-4130-41a2-a8c7-f0869189d1bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:08.485434 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5fc1ecaa-4130-41a2-a8c7-f0869189d1bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:08.492729 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5fc1ecaa-4130-41a2-a8c7-f0869189d1bf tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1547 microversion: 2.1 time: 0.150557 May 17 18:23:08.493299 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 272/602] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:08 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:08.508710 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b08b93f8-d429-40b0-ac7f-e3df4cd8e454 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:08.509328 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b08b93f8-d429-40b0-ac7f-e3df4cd8e454 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:08.515264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b08b93f8-d429-40b0-ac7f-e3df4cd8e454 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:08.515719 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b08b93f8-d429-40b0-ac7f-e3df4cd8e454 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:08.516484 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b08b93f8-d429-40b0-ac7f-e3df4cd8e454 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:08.516919 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b08b93f8-d429-40b0-ac7f-e3df4cd8e454 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:08.639921 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b08b93f8-d429-40b0-ac7f-e3df4cd8e454 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:08.647159 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b08b93f8-d429-40b0-ac7f-e3df4cd8e454 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1547 microversion: 2.1 time: 0.142255 May 17 18:23:08.647717 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 331/603] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:08 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1547 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:08.662992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-93626f60-1ee8-48dd-9481-8f672c381b1e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:08.666400 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-93626f60-1ee8-48dd-9481-8f672c381b1e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:08.667167 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-93626f60-1ee8-48dd-9481-8f672c381b1e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Searching by: {'deleted': False, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb'} {{(pid=117099) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 17 18:23:08.673506 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-93626f60-1ee8-48dd-9481-8f672c381b1e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:08.673967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-93626f60-1ee8-48dd-9481-8f672c381b1e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:08.674762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-93626f60-1ee8-48dd-9481-8f672c381b1e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:08.675201 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-93626f60-1ee8-48dd-9481-8f672c381b1e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:08.762628 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.multi_cell_list [None req-93626f60-1ee8-48dd-9481-8f672c381b1e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117099) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 17 18:23:08.856240 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-93626f60-1ee8-48dd-9481-8f672c381b1e tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.196778 May 17 18:23:08.856762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 273/604] 10.222.0.65 () {58 vars in 1124 bytes} [Tue May 17 18:23:08 2022] GET /compute/v2.1/servers => generated 342 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:23:08.867170 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a0e0454a-19e8-45ac-bbf9-421ef907fff7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:08.867780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a0e0454a-19e8-45ac-bbf9-421ef907fff7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:08.873629 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a0e0454a-19e8-45ac-bbf9-421ef907fff7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:08.874072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a0e0454a-19e8-45ac-bbf9-421ef907fff7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:08.874828 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a0e0454a-19e8-45ac-bbf9-421ef907fff7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:08.875258 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a0e0454a-19e8-45ac-bbf9-421ef907fff7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:09.008258 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a0e0454a-19e8-45ac-bbf9-421ef907fff7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:09.016854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a0e0454a-19e8-45ac-bbf9-421ef907fff7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1547 microversion: 2.1 time: 0.153731 May 17 18:23:09.017430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 332/605] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:08 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:09.349232 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-21185071-0121-4c7f-a68d-654754f1e8b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:09.349890 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-21185071-0121-4c7f-a68d-654754f1e8b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:09.356631 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-21185071-0121-4c7f-a68d-654754f1e8b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:09.357327 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-21185071-0121-4c7f-a68d-654754f1e8b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:09.358378 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-21185071-0121-4c7f-a68d-654754f1e8b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:09.358957 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-21185071-0121-4c7f-a68d-654754f1e8b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:09.483070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-21185071-0121-4c7f-a68d-654754f1e8b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:09.490924 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-21185071-0121-4c7f-a68d-654754f1e8b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:09.492430 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-21185071-0121-4c7f-a68d-654754f1e8b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:09.493620 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-21185071-0121-4c7f-a68d-654754f1e8b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1740 microversion: 2.20 time: 0.148258 May 17 18:23:09.494176 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 274/606] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:09 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1740 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:10.368509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-64ac2378-9c4b-482a-8f10-41f559e489e5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:10.371976 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-64ac2378-9c4b-482a-8f10-41f559e489e5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:10.385894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-64ac2378-9c4b-482a-8f10-41f559e489e5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:10.387206 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-64ac2378-9c4b-482a-8f10-41f559e489e5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:10.388232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-64ac2378-9c4b-482a-8f10-41f559e489e5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:10.388679 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-64ac2378-9c4b-482a-8f10-41f559e489e5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:10.416890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-64ac2378-9c4b-482a-8f10-41f559e489e5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lazy-loading 'flavor' on Instance uuid b94d1524-97f8-49d7-8685-184066d438d2 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:23:10.521925 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f83b812c-32a5-46fc-ac05-ca27eece7920 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:10.522535 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f83b812c-32a5-46fc-ac05-ca27eece7920 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:10.537313 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f83b812c-32a5-46fc-ac05-ca27eece7920 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:10.537889 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f83b812c-32a5-46fc-ac05-ca27eece7920 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:10.538783 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f83b812c-32a5-46fc-ac05-ca27eece7920 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:10.539252 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f83b812c-32a5-46fc-ac05-ca27eece7920 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:10.602321 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-64ac2378-9c4b-482a-8f10-41f559e489e5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "POST /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/action" status: 200 len: 32 microversion: 2.1 time: 0.240334 May 17 18:23:10.603568 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 333/607] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:23:10 2022] POST /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/action => generated 32 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:23:10.622026 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3b147a60-1a90-4873-9041-64aa543fa24f tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4cb29bde-8f57-4fc0-b463-e98e6b273913"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:10.623809 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3b147a60-1a90-4873-9041-64aa543fa24f tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:10.634969 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3b147a60-1a90-4873-9041-64aa543fa24f tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:10.635589 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3b147a60-1a90-4873-9041-64aa543fa24f tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:10.638074 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3b147a60-1a90-4873-9041-64aa543fa24f tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:10.639928 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3b147a60-1a90-4873-9041-64aa543fa24f tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:10.766500 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f83b812c-32a5-46fc-ac05-ca27eece7920 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:10.776970 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f83b812c-32a5-46fc-ac05-ca27eece7920 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:10.778813 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f83b812c-32a5-46fc-ac05-ca27eece7920 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:10.780159 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f83b812c-32a5-46fc-ac05-ca27eece7920 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1740 microversion: 2.20 time: 0.270970 May 17 18:23:10.781175 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 275/608] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:10 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:10.787450 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a0f6c46f-7017-4298-a2ed-d90db8f27e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:10.788257 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a0f6c46f-7017-4298-a2ed-d90db8f27e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:10.795261 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0f6c46f-7017-4298-a2ed-d90db8f27e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:10.795714 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0f6c46f-7017-4298-a2ed-d90db8f27e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:10.796584 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0f6c46f-7017-4298-a2ed-d90db8f27e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:10.796933 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0f6c46f-7017-4298-a2ed-d90db8f27e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:11.003530 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a0f6c46f-7017-4298-a2ed-d90db8f27e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:11.014760 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a0f6c46f-7017-4298-a2ed-d90db8f27e81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.230578 May 17 18:23:11.015659 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 276/609] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:10 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:11.034814 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3b147a60-1a90-4873-9041-64aa543fa24f tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "POST /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.429703 May 17 18:23:11.035833 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 334/610] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:23:10 2022] POST /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:23:11.798147 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1c91ef24-498b-4068-a0c7-37cf897e91dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:11.799560 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1c91ef24-498b-4068-a0c7-37cf897e91dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:11.806485 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1c91ef24-498b-4068-a0c7-37cf897e91dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:11.807196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1c91ef24-498b-4068-a0c7-37cf897e91dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:11.808134 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1c91ef24-498b-4068-a0c7-37cf897e91dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:11.808584 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1c91ef24-498b-4068-a0c7-37cf897e91dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:11.960047 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1c91ef24-498b-4068-a0c7-37cf897e91dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:11.967475 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1c91ef24-498b-4068-a0c7-37cf897e91dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:11.968964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1c91ef24-498b-4068-a0c7-37cf897e91dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:11.970359 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1c91ef24-498b-4068-a0c7-37cf897e91dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1740 microversion: 2.20 time: 0.176062 May 17 18:23:11.980866 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 277/611] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:11 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:12.032814 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a87ae3b0-33ef-4732-91fc-6f2a870ecf6b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:12.033532 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a87ae3b0-33ef-4732-91fc-6f2a870ecf6b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:12.041364 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a87ae3b0-33ef-4732-91fc-6f2a870ecf6b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:12.042191 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a87ae3b0-33ef-4732-91fc-6f2a870ecf6b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:12.043183 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a87ae3b0-33ef-4732-91fc-6f2a870ecf6b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:12.043614 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a87ae3b0-33ef-4732-91fc-6f2a870ecf6b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:12.198780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a87ae3b0-33ef-4732-91fc-6f2a870ecf6b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:12.208278 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a87ae3b0-33ef-4732-91fc-6f2a870ecf6b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.179720 May 17 18:23:12.208859 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 335/612] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:12 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:12.988208 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-44818933-35fb-40bc-8e94-b23212784ebb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:12.988796 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-44818933-35fb-40bc-8e94-b23212784ebb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:12.996010 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-44818933-35fb-40bc-8e94-b23212784ebb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:12.996566 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-44818933-35fb-40bc-8e94-b23212784ebb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:12.997432 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-44818933-35fb-40bc-8e94-b23212784ebb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:12.997992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-44818933-35fb-40bc-8e94-b23212784ebb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:13.139472 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-44818933-35fb-40bc-8e94-b23212784ebb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:13.148414 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-44818933-35fb-40bc-8e94-b23212784ebb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:13.149961 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-44818933-35fb-40bc-8e94-b23212784ebb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:13.152049 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-44818933-35fb-40bc-8e94-b23212784ebb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1740 microversion: 2.20 time: 0.167190 May 17 18:23:13.152905 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 278/613] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:12 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:13.233599 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1df07517-0b15-46aa-8d88-d894e2ca124c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:13.235205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1df07517-0b15-46aa-8d88-d894e2ca124c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:13.244515 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1df07517-0b15-46aa-8d88-d894e2ca124c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:13.245081 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1df07517-0b15-46aa-8d88-d894e2ca124c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:13.246718 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1df07517-0b15-46aa-8d88-d894e2ca124c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:13.247164 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1df07517-0b15-46aa-8d88-d894e2ca124c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:13.388473 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1df07517-0b15-46aa-8d88-d894e2ca124c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:13.396839 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1df07517-0b15-46aa-8d88-d894e2ca124c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.168600 May 17 18:23:13.398001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 336/614] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:13 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:14.173850 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a24361c1-b8df-4fee-ac19-af1e88584a1a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:14.175173 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a24361c1-b8df-4fee-ac19-af1e88584a1a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:14.186267 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a24361c1-b8df-4fee-ac19-af1e88584a1a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:14.187223 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a24361c1-b8df-4fee-ac19-af1e88584a1a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:14.188439 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a24361c1-b8df-4fee-ac19-af1e88584a1a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:14.189446 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a24361c1-b8df-4fee-ac19-af1e88584a1a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:14.356987 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a24361c1-b8df-4fee-ac19-af1e88584a1a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:14.366388 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a24361c1-b8df-4fee-ac19-af1e88584a1a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:14.368430 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a24361c1-b8df-4fee-ac19-af1e88584a1a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:14.369947 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a24361c1-b8df-4fee-ac19-af1e88584a1a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1740 microversion: 2.20 time: 0.203592 May 17 18:23:14.372884 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 279/615] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:14 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1740 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:14.415646 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1b0b2f04-9417-4ae2-8e8d-0358ed6fd9a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:14.416280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1b0b2f04-9417-4ae2-8e8d-0358ed6fd9a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:14.425442 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b0b2f04-9417-4ae2-8e8d-0358ed6fd9a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:14.426222 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b0b2f04-9417-4ae2-8e8d-0358ed6fd9a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:14.427408 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b0b2f04-9417-4ae2-8e8d-0358ed6fd9a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:14.428015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b0b2f04-9417-4ae2-8e8d-0358ed6fd9a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:14.568007 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1b0b2f04-9417-4ae2-8e8d-0358ed6fd9a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:14.577406 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1b0b2f04-9417-4ae2-8e8d-0358ed6fd9a2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.165868 May 17 18:23:14.578277 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 337/616] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:14 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:15.389218 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2fd785b0-f81e-4c8e-8496-5e6d91ed5440 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:15.389888 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2fd785b0-f81e-4c8e-8496-5e6d91ed5440 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:15.397266 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2fd785b0-f81e-4c8e-8496-5e6d91ed5440 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:15.397754 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2fd785b0-f81e-4c8e-8496-5e6d91ed5440 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:15.398837 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2fd785b0-f81e-4c8e-8496-5e6d91ed5440 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:15.399282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2fd785b0-f81e-4c8e-8496-5e6d91ed5440 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:15.562199 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2fd785b0-f81e-4c8e-8496-5e6d91ed5440 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:15.571808 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2fd785b0-f81e-4c8e-8496-5e6d91ed5440 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:15.574688 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2fd785b0-f81e-4c8e-8496-5e6d91ed5440 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:15.576072 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2fd785b0-f81e-4c8e-8496-5e6d91ed5440 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1740 microversion: 2.20 time: 0.191651 May 17 18:23:15.587252 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 280/617] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:15 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:15.595618 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c45ba424-9ea6-4188-a8b5-1f33695aa8df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:15.596242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c45ba424-9ea6-4188-a8b5-1f33695aa8df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:15.603444 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c45ba424-9ea6-4188-a8b5-1f33695aa8df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:15.603898 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c45ba424-9ea6-4188-a8b5-1f33695aa8df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:15.604787 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c45ba424-9ea6-4188-a8b5-1f33695aa8df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:15.605233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c45ba424-9ea6-4188-a8b5-1f33695aa8df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:15.741007 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c45ba424-9ea6-4188-a8b5-1f33695aa8df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:15.750925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c45ba424-9ea6-4188-a8b5-1f33695aa8df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.159410 May 17 18:23:15.751898 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 338/618] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:15 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:16.595009 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-cedd9349-4933-4472-94ee-998419b78ca2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:16.595567 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-cedd9349-4933-4472-94ee-998419b78ca2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:16.601983 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cedd9349-4933-4472-94ee-998419b78ca2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:16.602738 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cedd9349-4933-4472-94ee-998419b78ca2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:16.603755 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cedd9349-4933-4472-94ee-998419b78ca2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:16.604416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cedd9349-4933-4472-94ee-998419b78ca2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:16.755653 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-cedd9349-4933-4472-94ee-998419b78ca2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:16.767896 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-83141c74-6aef-47c5-93c5-6e93b26a9af7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:16.768507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-83141c74-6aef-47c5-93c5-6e93b26a9af7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:16.770622 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-cedd9349-4933-4472-94ee-998419b78ca2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:16.772280 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-cedd9349-4933-4472-94ee-998419b78ca2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:16.773553 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-cedd9349-4933-4472-94ee-998419b78ca2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1740 microversion: 2.20 time: 0.182494 May 17 18:23:16.774624 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 281/619] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:16 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:16.786669 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-83141c74-6aef-47c5-93c5-6e93b26a9af7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:16.787413 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-83141c74-6aef-47c5-93c5-6e93b26a9af7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:16.788480 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-83141c74-6aef-47c5-93c5-6e93b26a9af7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:16.789157 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-83141c74-6aef-47c5-93c5-6e93b26a9af7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:16.950192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-83141c74-6aef-47c5-93c5-6e93b26a9af7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:16.959670 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-83141c74-6aef-47c5-93c5-6e93b26a9af7 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.195126 May 17 18:23:16.960359 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 339/620] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:16 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:17.792730 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b1d2ed0d-8ce7-49cd-b52a-7af08862a6a1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:17.793277 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b1d2ed0d-8ce7-49cd-b52a-7af08862a6a1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:17.799797 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b1d2ed0d-8ce7-49cd-b52a-7af08862a6a1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:17.800325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b1d2ed0d-8ce7-49cd-b52a-7af08862a6a1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:17.801027 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b1d2ed0d-8ce7-49cd-b52a-7af08862a6a1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:17.801482 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b1d2ed0d-8ce7-49cd-b52a-7af08862a6a1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:17.936896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b1d2ed0d-8ce7-49cd-b52a-7af08862a6a1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:17.950535 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b1d2ed0d-8ce7-49cd-b52a-7af08862a6a1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:17.952374 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b1d2ed0d-8ce7-49cd-b52a-7af08862a6a1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:17.953682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b1d2ed0d-8ce7-49cd-b52a-7af08862a6a1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1740 microversion: 2.20 time: 0.165482 May 17 18:23:17.954627 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 282/621] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:17 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:17.978216 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c7664621-f91a-4dad-a73e-3ccd1e09e9c4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:17.978916 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c7664621-f91a-4dad-a73e-3ccd1e09e9c4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:17.986116 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7664621-f91a-4dad-a73e-3ccd1e09e9c4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:17.986639 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7664621-f91a-4dad-a73e-3ccd1e09e9c4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:17.987575 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7664621-f91a-4dad-a73e-3ccd1e09e9c4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:17.988104 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7664621-f91a-4dad-a73e-3ccd1e09e9c4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:18.209847 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c7664621-f91a-4dad-a73e-3ccd1e09e9c4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:18.216845 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c7664621-f91a-4dad-a73e-3ccd1e09e9c4 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.242502 May 17 18:23:18.217412 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 340/622] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:17 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:18.678502 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e05387ef-2de2-4812-9a7a-5ac13da53c9b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:18.679421 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e05387ef-2de2-4812-9a7a-5ac13da53c9b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:18.686142 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e05387ef-2de2-4812-9a7a-5ac13da53c9b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:18.686698 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e05387ef-2de2-4812-9a7a-5ac13da53c9b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:18.687544 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e05387ef-2de2-4812-9a7a-5ac13da53c9b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:18.688050 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e05387ef-2de2-4812-9a7a-5ac13da53c9b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:18.823534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e05387ef-2de2-4812-9a7a-5ac13da53c9b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:18.837924 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e05387ef-2de2-4812-9a7a-5ac13da53c9b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1593 microversion: 2.1 time: 0.163227 May 17 18:23:18.838510 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 283/623] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:18 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1593 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:18.972358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0dbbfb88-ddef-4070-91eb-70c527a60a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:18.972980 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0dbbfb88-ddef-4070-91eb-70c527a60a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:18.980183 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0dbbfb88-ddef-4070-91eb-70c527a60a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:18.980748 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0dbbfb88-ddef-4070-91eb-70c527a60a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:18.981420 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0dbbfb88-ddef-4070-91eb-70c527a60a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:18.981991 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0dbbfb88-ddef-4070-91eb-70c527a60a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:19.125010 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0dbbfb88-ddef-4070-91eb-70c527a60a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:19.133764 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0dbbfb88-ddef-4070-91eb-70c527a60a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:19.136407 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0dbbfb88-ddef-4070-91eb-70c527a60a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:19.138719 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0dbbfb88-ddef-4070-91eb-70c527a60a79 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1740 microversion: 2.20 time: 0.170284 May 17 18:23:19.139288 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 341/624] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:18 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:19.234435 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-05265f8c-0600-4b29-8431-b5ee237364ec tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:19.235422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-05265f8c-0600-4b29-8431-b5ee237364ec tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:19.243016 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-05265f8c-0600-4b29-8431-b5ee237364ec tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:19.243599 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-05265f8c-0600-4b29-8431-b5ee237364ec tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:19.244473 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-05265f8c-0600-4b29-8431-b5ee237364ec tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:19.245005 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-05265f8c-0600-4b29-8431-b5ee237364ec tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:19.387711 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-05265f8c-0600-4b29-8431-b5ee237364ec tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:19.395736 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-05265f8c-0600-4b29-8431-b5ee237364ec tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.165140 May 17 18:23:19.415196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 284/625] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:19 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:20.156640 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-82712c21-e578-477f-a90f-1bc9946a735e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:20.157438 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-82712c21-e578-477f-a90f-1bc9946a735e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:20.163722 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-82712c21-e578-477f-a90f-1bc9946a735e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:20.164171 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-82712c21-e578-477f-a90f-1bc9946a735e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:20.164941 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-82712c21-e578-477f-a90f-1bc9946a735e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:20.165383 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-82712c21-e578-477f-a90f-1bc9946a735e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:20.301559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-82712c21-e578-477f-a90f-1bc9946a735e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:20.310096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-82712c21-e578-477f-a90f-1bc9946a735e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:20.311618 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-82712c21-e578-477f-a90f-1bc9946a735e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:20.312875 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-82712c21-e578-477f-a90f-1bc9946a735e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1722 microversion: 2.20 time: 0.160113 May 17 18:23:20.313485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 342/626] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:20 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:20.414809 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-102616cc-a04a-4a91-882f-fc662e1ea605 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:20.415425 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-102616cc-a04a-4a91-882f-fc662e1ea605 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:20.422299 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-102616cc-a04a-4a91-882f-fc662e1ea605 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:20.422747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-102616cc-a04a-4a91-882f-fc662e1ea605 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:20.423532 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-102616cc-a04a-4a91-882f-fc662e1ea605 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:20.423981 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-102616cc-a04a-4a91-882f-fc662e1ea605 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:20.549439 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-102616cc-a04a-4a91-882f-fc662e1ea605 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:20.557537 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-102616cc-a04a-4a91-882f-fc662e1ea605 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.146543 May 17 18:23:20.558112 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 285/627] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:20 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:20.939621 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-15bb3462-da00-448b-879d-41d6930a7eb8 req-ea1c2b07-ebd3-4869-a1dc-cf159ebb8b0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e42d88-56d2-431d-9b8a-874306f6895d", "tag": "cc5efd46-7563-4b9a-9d0d-a824d9fd3faf"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:20.950325 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-15bb3462-da00-448b-879d-41d6930a7eb8 req-ea1c2b07-ebd3-4869-a1dc-cf159ebb8b0a service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:20.951545 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-15bb3462-da00-448b-879d-41d6930a7eb8 req-ea1c2b07-ebd3-4869-a1dc-cf159ebb8b0a service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:20.965305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-15bb3462-da00-448b-879d-41d6930a7eb8 req-ea1c2b07-ebd3-4869-a1dc-cf159ebb8b0a service nova] Creating event network-changed:cc5efd46-7563-4b9a-9d0d-a824d9fd3faf for instance d4e42d88-56d2-431d-9b8a-874306f6895d on hv-cinder-83736 May 17 18:23:20.972546 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-15bb3462-da00-448b-879d-41d6930a7eb8 req-ea1c2b07-ebd3-4869-a1dc-cf159ebb8b0a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035831 May 17 18:23:20.973817 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 343/628] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:23:21.331760 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2191525a-7c90-48ff-ba0d-8340b500c557 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:21.332250 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2191525a-7c90-48ff-ba0d-8340b500c557 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:21.339388 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2191525a-7c90-48ff-ba0d-8340b500c557 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:21.340043 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2191525a-7c90-48ff-ba0d-8340b500c557 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:21.341006 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2191525a-7c90-48ff-ba0d-8340b500c557 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:21.341740 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2191525a-7c90-48ff-ba0d-8340b500c557 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:21.504857 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2191525a-7c90-48ff-ba0d-8340b500c557 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:21.515236 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2191525a-7c90-48ff-ba0d-8340b500c557 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:21.519617 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2191525a-7c90-48ff-ba0d-8340b500c557 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:21.521396 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2191525a-7c90-48ff-ba0d-8340b500c557 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1722 microversion: 2.20 time: 0.193781 May 17 18:23:21.522121 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 286/629] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:21 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:21.576733 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d1918b9c-3b08-4b8b-b6a4-05d43e608b3c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:21.578041 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d1918b9c-3b08-4b8b-b6a4-05d43e608b3c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:21.584830 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d1918b9c-3b08-4b8b-b6a4-05d43e608b3c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:21.585375 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d1918b9c-3b08-4b8b-b6a4-05d43e608b3c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:21.586292 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d1918b9c-3b08-4b8b-b6a4-05d43e608b3c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:21.586823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d1918b9c-3b08-4b8b-b6a4-05d43e608b3c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:21.739463 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d1918b9c-3b08-4b8b-b6a4-05d43e608b3c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:21.748218 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d1918b9c-3b08-4b8b-b6a4-05d43e608b3c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.177037 May 17 18:23:21.755924 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 344/630] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:21 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:21.945371 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9ddb5033-6090-400a-9b1d-c55e42a34cc3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1114474463"}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:21.946012 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-9ddb5033-6090-400a-9b1d-c55e42a34cc3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:21.952275 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9ddb5033-6090-400a-9b1d-c55e42a34cc3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:21.952803 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9ddb5033-6090-400a-9b1d-c55e42a34cc3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:21.953701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9ddb5033-6090-400a-9b1d-c55e42a34cc3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:21.954229 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9ddb5033-6090-400a-9b1d-c55e42a34cc3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:22.091158 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.network.security_group_api [None req-9ddb5033-6090-400a-9b1d-c55e42a34cc3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Adding security group b3a07366-5f97-4c55-a2cf-c20fd251d85c to port cc5efd46-7563-4b9a-9d0d-a824d9fd3faf May 17 18:23:22.493717 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9ddb5033-6090-400a-9b1d-c55e42a34cc3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "POST /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/action" status: 202 len: 0 microversion: 2.1 time: 0.551929 May 17 18:23:22.495655 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 287/631] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:23:21 2022] POST /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:23:22.503146 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5c712e3a-e886-44af-9390-727821d33685 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:22.504182 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5c712e3a-e886-44af-9390-727821d33685 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:22.511588 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5c712e3a-e886-44af-9390-727821d33685 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:22.511904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5c712e3a-e886-44af-9390-727821d33685 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:22.512705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5c712e3a-e886-44af-9390-727821d33685 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:22.513149 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5c712e3a-e886-44af-9390-727821d33685 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:22.600643 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-c7ddb70f-51d2-41d8-813b-b7ca32939ad8 req-60cedec5-41c0-4bb9-ae10-0a50847b8e00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e42d88-56d2-431d-9b8a-874306f6895d", "tag": "cc5efd46-7563-4b9a-9d0d-a824d9fd3faf"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:22.613031 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-c7ddb70f-51d2-41d8-813b-b7ca32939ad8 req-60cedec5-41c0-4bb9-ae10-0a50847b8e00 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:22.613942 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-c7ddb70f-51d2-41d8-813b-b7ca32939ad8 req-60cedec5-41c0-4bb9-ae10-0a50847b8e00 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:22.629074 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-c7ddb70f-51d2-41d8-813b-b7ca32939ad8 req-60cedec5-41c0-4bb9-ae10-0a50847b8e00 service nova] Creating event network-changed:cc5efd46-7563-4b9a-9d0d-a824d9fd3faf for instance d4e42d88-56d2-431d-9b8a-874306f6895d on hv-cinder-83736 May 17 18:23:22.634864 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-c7ddb70f-51d2-41d8-813b-b7ca32939ad8 req-60cedec5-41c0-4bb9-ae10-0a50847b8e00 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130557 May 17 18:23:22.636811 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 288/632] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:23:22.644052 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d330cdab-b2f0-405b-861e-d9141f624b8a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:22.645529 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d330cdab-b2f0-405b-861e-d9141f624b8a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:22.654375 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d330cdab-b2f0-405b-861e-d9141f624b8a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:22.655096 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d330cdab-b2f0-405b-861e-d9141f624b8a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:22.656058 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d330cdab-b2f0-405b-861e-d9141f624b8a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:22.656651 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d330cdab-b2f0-405b-861e-d9141f624b8a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:22.699672 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5c712e3a-e886-44af-9390-727821d33685 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:22.710990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5c712e3a-e886-44af-9390-727821d33685 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1640 microversion: 2.1 time: 0.210895 May 17 18:23:22.712275 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 345/633] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:22 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1640 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:22.766269 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4901cd81-b886-45ce-93c9-afe078719514 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:22.767701 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4901cd81-b886-45ce-93c9-afe078719514 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:22.773802 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4901cd81-b886-45ce-93c9-afe078719514 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:22.774693 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4901cd81-b886-45ce-93c9-afe078719514 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:22.775562 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4901cd81-b886-45ce-93c9-afe078719514 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:22.776081 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4901cd81-b886-45ce-93c9-afe078719514 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:22.800098 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d330cdab-b2f0-405b-861e-d9141f624b8a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:22.809201 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d330cdab-b2f0-405b-861e-d9141f624b8a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:22.811635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d330cdab-b2f0-405b-861e-d9141f624b8a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:22.812925 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d330cdab-b2f0-405b-861e-d9141f624b8a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1722 microversion: 2.20 time: 0.174712 May 17 18:23:22.814036 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 289/634] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:22 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:22.903915 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4901cd81-b886-45ce-93c9-afe078719514 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:22.912057 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4901cd81-b886-45ce-93c9-afe078719514 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.149841 May 17 18:23:22.912625 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 346/635] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:22 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:23.704944 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-b17f29aa-a670-43d4-9612-df24622fab0b req-41bc1316-2afa-4d09-98ee-6653cae49477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e", "name": "network-vif-unplugged", "status": "completed", "tag": "06e106bb-68fb-497b-a3fb-dae45c0c334c"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:23.713371 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-b17f29aa-a670-43d4-9612-df24622fab0b req-41bc1316-2afa-4d09-98ee-6653cae49477 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:23.714714 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-b17f29aa-a670-43d4-9612-df24622fab0b req-41bc1316-2afa-4d09-98ee-6653cae49477 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:23.725680 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.compute.server_external_events [req-b17f29aa-a670-43d4-9612-df24622fab0b req-41bc1316-2afa-4d09-98ee-6653cae49477 service nova] Unable to find a host for instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e. Dropping event network-vif-unplugged {{(pid=117099) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 17 18:23:23.726584 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-b17f29aa-a670-43d4-9612-df24622fab0b req-41bc1316-2afa-4d09-98ee-6653cae49477 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.096078 May 17 18:23:23.727167 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 290/636] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 97 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 17 18:23:23.831598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-721904d5-5d2e-4458-bded-473699e7aadf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:23.832132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-721904d5-5d2e-4458-bded-473699e7aadf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:23.839888 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-721904d5-5d2e-4458-bded-473699e7aadf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:23.840346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-721904d5-5d2e-4458-bded-473699e7aadf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:23.841124 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-721904d5-5d2e-4458-bded-473699e7aadf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:23.841594 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-721904d5-5d2e-4458-bded-473699e7aadf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:23.929705 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-585f00eb-0be0-4819-859b-a5ed7deb2b91 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:23.930557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-585f00eb-0be0-4819-859b-a5ed7deb2b91 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:23.936897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-585f00eb-0be0-4819-859b-a5ed7deb2b91 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:23.937608 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-585f00eb-0be0-4819-859b-a5ed7deb2b91 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:23.938570 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-585f00eb-0be0-4819-859b-a5ed7deb2b91 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:23.939490 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-585f00eb-0be0-4819-859b-a5ed7deb2b91 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:23.991434 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-721904d5-5d2e-4458-bded-473699e7aadf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:24.001300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-721904d5-5d2e-4458-bded-473699e7aadf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:24.003236 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-721904d5-5d2e-4458-bded-473699e7aadf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:24.004403 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-721904d5-5d2e-4458-bded-473699e7aadf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1665 microversion: 2.20 time: 0.176897 May 17 18:23:24.005501 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 347/637] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:23 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1665 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:24.022471 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-bfd4c849-d774-4dae-a2a5-b2286e6cb8ce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "611d0205-62b4-4cee-8e02-43b0389f1e0c"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:24.023608 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-bfd4c849-d774-4dae-a2a5-b2286e6cb8ce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:24.029611 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bfd4c849-d774-4dae-a2a5-b2286e6cb8ce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:24.030062 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bfd4c849-d774-4dae-a2a5-b2286e6cb8ce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:24.030834 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bfd4c849-d774-4dae-a2a5-b2286e6cb8ce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:24.031265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bfd4c849-d774-4dae-a2a5-b2286e6cb8ce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:24.086892 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-585f00eb-0be0-4819-859b-a5ed7deb2b91 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:24.096497 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-585f00eb-0be0-4819-859b-a5ed7deb2b91 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.170503 May 17 18:23:24.097087 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 291/638] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:23 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:24.314544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-bfd4c849-d774-4dae-a2a5-b2286e6cb8ce tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "POST /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.295883 May 17 18:23:24.315235 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 348/639] 10.222.0.65 () {62 vars in 1363 bytes} [Tue May 17 18:23:24 2022] POST /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments => generated 188 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:23:24.426153 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8ca3c15a-b12c-448a-85c2-a581fbb40031 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:24.426731 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8ca3c15a-b12c-448a-85c2-a581fbb40031 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:24.433162 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ca3c15a-b12c-448a-85c2-a581fbb40031 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:24.433661 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ca3c15a-b12c-448a-85c2-a581fbb40031 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:24.434438 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ca3c15a-b12c-448a-85c2-a581fbb40031 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:24.434885 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ca3c15a-b12c-448a-85c2-a581fbb40031 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:24.568317 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8ca3c15a-b12c-448a-85c2-a581fbb40031 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "POST /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/action" status: 202 len: 0 microversion: 2.20 time: 0.146009 May 17 18:23:24.568911 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 292/640] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 17 18:23:24 2022] POST /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/action => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 18:23:24.577122 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-04c62861-6668-49b2-93a7-f46c426188ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:24.577763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-04c62861-6668-49b2-93a7-f46c426188ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:24.584372 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04c62861-6668-49b2-93a7-f46c426188ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:24.584927 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04c62861-6668-49b2-93a7-f46c426188ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:24.585742 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04c62861-6668-49b2-93a7-f46c426188ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:24.586180 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04c62861-6668-49b2-93a7-f46c426188ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:24.719655 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-04c62861-6668-49b2-93a7-f46c426188ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:24.728102 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-04c62861-6668-49b2-93a7-f46c426188ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:24.730313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-04c62861-6668-49b2-93a7-f46c426188ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:24.731492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-04c62861-6668-49b2-93a7-f46c426188ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1751 microversion: 2.20 time: 0.158469 May 17 18:23:24.732046 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 349/641] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:24 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:23:25.113442 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-46b02de4-014a-4b23-90b4-1bce3447ec75 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:25.114017 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-46b02de4-014a-4b23-90b4-1bce3447ec75 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:25.119713 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-46b02de4-014a-4b23-90b4-1bce3447ec75 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:25.120166 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-46b02de4-014a-4b23-90b4-1bce3447ec75 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:25.120929 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-46b02de4-014a-4b23-90b4-1bce3447ec75 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:25.121367 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-46b02de4-014a-4b23-90b4-1bce3447ec75 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:25.253514 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-46b02de4-014a-4b23-90b4-1bce3447ec75 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:25.262093 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-46b02de4-014a-4b23-90b4-1bce3447ec75 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.152986 May 17 18:23:25.262660 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 293/642] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:25 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:25.750796 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-676295de-cffb-4995-9d01-47f1bcaf8618 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:25.751332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-676295de-cffb-4995-9d01-47f1bcaf8618 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:25.757851 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-676295de-cffb-4995-9d01-47f1bcaf8618 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:25.758306 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-676295de-cffb-4995-9d01-47f1bcaf8618 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:25.759071 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-676295de-cffb-4995-9d01-47f1bcaf8618 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:25.759515 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-676295de-cffb-4995-9d01-47f1bcaf8618 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:25.887740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-676295de-cffb-4995-9d01-47f1bcaf8618 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:25.895913 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-676295de-cffb-4995-9d01-47f1bcaf8618 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:25.897402 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-676295de-cffb-4995-9d01-47f1bcaf8618 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:25.898574 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-676295de-cffb-4995-9d01-47f1bcaf8618 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1753 microversion: 2.20 time: 0.151824 May 17 18:23:25.899129 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 350/643] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:25 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:26.279037 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-cd407551-e924-465e-a63a-8678c5d6a3b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:26.279589 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-cd407551-e924-465e-a63a-8678c5d6a3b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:26.285846 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cd407551-e924-465e-a63a-8678c5d6a3b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:26.286305 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cd407551-e924-465e-a63a-8678c5d6a3b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:26.287077 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cd407551-e924-465e-a63a-8678c5d6a3b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:26.287541 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cd407551-e924-465e-a63a-8678c5d6a3b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:26.413897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-cd407551-e924-465e-a63a-8678c5d6a3b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:26.422228 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-cd407551-e924-465e-a63a-8678c5d6a3b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.147664 May 17 18:23:26.422798 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 294/644] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:26 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:26.917798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f3275d03-b609-4d98-b207-9cbd056bfe30 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:26.918421 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f3275d03-b609-4d98-b207-9cbd056bfe30 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:26.924787 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f3275d03-b609-4d98-b207-9cbd056bfe30 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:26.925251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f3275d03-b609-4d98-b207-9cbd056bfe30 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:26.926057 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f3275d03-b609-4d98-b207-9cbd056bfe30 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:26.926501 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f3275d03-b609-4d98-b207-9cbd056bfe30 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:27.056687 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f3275d03-b609-4d98-b207-9cbd056bfe30 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:27.065601 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f3275d03-b609-4d98-b207-9cbd056bfe30 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:27.067148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f3275d03-b609-4d98-b207-9cbd056bfe30 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:27.068303 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f3275d03-b609-4d98-b207-9cbd056bfe30 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.154807 May 17 18:23:27.068864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 351/645] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:26 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:27.439491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7ed1d72b-5b65-4365-8aec-c6b838befcc5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:27.440113 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7ed1d72b-5b65-4365-8aec-c6b838befcc5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:27.446612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ed1d72b-5b65-4365-8aec-c6b838befcc5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:27.447070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ed1d72b-5b65-4365-8aec-c6b838befcc5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:27.447851 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ed1d72b-5b65-4365-8aec-c6b838befcc5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:27.448300 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ed1d72b-5b65-4365-8aec-c6b838befcc5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:27.628925 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7ed1d72b-5b65-4365-8aec-c6b838befcc5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:27.646014 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7ed1d72b-5b65-4365-8aec-c6b838befcc5 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.210140 May 17 18:23:27.647454 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 295/646] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:27 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:28.089287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b25349cc-f3e4-449c-ad9a-7377fdfc8231 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:28.090060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b25349cc-f3e4-449c-ad9a-7377fdfc8231 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:28.096463 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b25349cc-f3e4-449c-ad9a-7377fdfc8231 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:28.096922 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b25349cc-f3e4-449c-ad9a-7377fdfc8231 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:28.097740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b25349cc-f3e4-449c-ad9a-7377fdfc8231 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:28.098183 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b25349cc-f3e4-449c-ad9a-7377fdfc8231 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:28.228711 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b25349cc-f3e4-449c-ad9a-7377fdfc8231 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:28.239078 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b25349cc-f3e4-449c-ad9a-7377fdfc8231 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:28.240682 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b25349cc-f3e4-449c-ad9a-7377fdfc8231 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:28.242008 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b25349cc-f3e4-449c-ad9a-7377fdfc8231 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.157773 May 17 18:23:28.242564 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 352/647] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:28 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:28.664206 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1b71535f-de4e-4ee2-8451-d8f26e360c25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:28.664841 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1b71535f-de4e-4ee2-8451-d8f26e360c25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:28.671361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1b71535f-de4e-4ee2-8451-d8f26e360c25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:28.671956 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1b71535f-de4e-4ee2-8451-d8f26e360c25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:28.672867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1b71535f-de4e-4ee2-8451-d8f26e360c25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:28.673445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1b71535f-de4e-4ee2-8451-d8f26e360c25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:28.806150 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1b71535f-de4e-4ee2-8451-d8f26e360c25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:28.815478 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1b71535f-de4e-4ee2-8451-d8f26e360c25 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.155026 May 17 18:23:28.816059 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 296/648] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:28 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:29.260013 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6f287085-c439-4473-8bfe-ee9c0c2e036e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:29.261206 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6f287085-c439-4473-8bfe-ee9c0c2e036e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:29.268655 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6f287085-c439-4473-8bfe-ee9c0c2e036e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:29.269104 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6f287085-c439-4473-8bfe-ee9c0c2e036e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:29.269929 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6f287085-c439-4473-8bfe-ee9c0c2e036e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:29.270587 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6f287085-c439-4473-8bfe-ee9c0c2e036e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:29.400855 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6f287085-c439-4473-8bfe-ee9c0c2e036e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:29.409399 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6f287085-c439-4473-8bfe-ee9c0c2e036e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:29.410916 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6f287085-c439-4473-8bfe-ee9c0c2e036e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:29.412076 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6f287085-c439-4473-8bfe-ee9c0c2e036e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.155931 May 17 18:23:29.412644 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 353/649] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:29 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:29.833979 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-83c0768e-6ba1-4726-8d6e-3e90348214c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:29.835264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-83c0768e-6ba1-4726-8d6e-3e90348214c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:29.841983 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83c0768e-6ba1-4726-8d6e-3e90348214c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:29.842437 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83c0768e-6ba1-4726-8d6e-3e90348214c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:29.843221 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83c0768e-6ba1-4726-8d6e-3e90348214c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:29.843667 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83c0768e-6ba1-4726-8d6e-3e90348214c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:29.978463 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-83c0768e-6ba1-4726-8d6e-3e90348214c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:29.987478 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-83c0768e-6ba1-4726-8d6e-3e90348214c6 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.157361 May 17 18:23:29.988061 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 297/650] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:29 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:30.430375 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1efb884c-ed0b-4bec-b9eb-339875f61bc3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:30.431097 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1efb884c-ed0b-4bec-b9eb-339875f61bc3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:30.437799 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1efb884c-ed0b-4bec-b9eb-339875f61bc3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:30.438251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1efb884c-ed0b-4bec-b9eb-339875f61bc3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:30.439260 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1efb884c-ed0b-4bec-b9eb-339875f61bc3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:30.439820 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1efb884c-ed0b-4bec-b9eb-339875f61bc3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:30.578972 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1efb884c-ed0b-4bec-b9eb-339875f61bc3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:30.588181 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1efb884c-ed0b-4bec-b9eb-339875f61bc3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:30.590304 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1efb884c-ed0b-4bec-b9eb-339875f61bc3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:30.591511 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1efb884c-ed0b-4bec-b9eb-339875f61bc3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.165012 May 17 18:23:30.592071 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 354/651] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:30 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:31.004501 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2bc3a210-a59c-4104-9d64-8048662fd51b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:31.005157 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2bc3a210-a59c-4104-9d64-8048662fd51b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:31.012081 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2bc3a210-a59c-4104-9d64-8048662fd51b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:31.012534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2bc3a210-a59c-4104-9d64-8048662fd51b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:31.013306 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2bc3a210-a59c-4104-9d64-8048662fd51b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:31.013773 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2bc3a210-a59c-4104-9d64-8048662fd51b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:31.152875 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2bc3a210-a59c-4104-9d64-8048662fd51b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:31.160982 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2bc3a210-a59c-4104-9d64-8048662fd51b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.160412 May 17 18:23:31.161623 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 298/652] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:30 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:31.610427 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0a2394be-e7da-45e4-b26b-b65da9b9645b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:31.611130 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0a2394be-e7da-45e4-b26b-b65da9b9645b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:31.618997 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0a2394be-e7da-45e4-b26b-b65da9b9645b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:31.619456 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0a2394be-e7da-45e4-b26b-b65da9b9645b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:31.620244 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0a2394be-e7da-45e4-b26b-b65da9b9645b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:31.620714 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0a2394be-e7da-45e4-b26b-b65da9b9645b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:31.762160 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0a2394be-e7da-45e4-b26b-b65da9b9645b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:31.770916 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0a2394be-e7da-45e4-b26b-b65da9b9645b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:31.772549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0a2394be-e7da-45e4-b26b-b65da9b9645b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:31.773758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0a2394be-e7da-45e4-b26b-b65da9b9645b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.167430 May 17 18:23:31.774309 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 355/653] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:31 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:32.177856 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b9f9f7e9-ba8e-4124-b2c2-1058f8074156 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:32.178452 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b9f9f7e9-ba8e-4124-b2c2-1058f8074156 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:32.185513 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b9f9f7e9-ba8e-4124-b2c2-1058f8074156 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:32.185972 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b9f9f7e9-ba8e-4124-b2c2-1058f8074156 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:32.186758 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b9f9f7e9-ba8e-4124-b2c2-1058f8074156 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:32.187197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b9f9f7e9-ba8e-4124-b2c2-1058f8074156 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:32.330842 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b9f9f7e9-ba8e-4124-b2c2-1058f8074156 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:32.338913 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b9f9f7e9-ba8e-4124-b2c2-1058f8074156 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.164919 May 17 18:23:32.339487 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 299/654] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:32 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:32.358734 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c518af97-2a0e-441c-badb-588951a98552 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:32.359303 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c518af97-2a0e-441c-badb-588951a98552 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:32.365490 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c518af97-2a0e-441c-badb-588951a98552 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:32.366075 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c518af97-2a0e-441c-badb-588951a98552 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:32.366953 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c518af97-2a0e-441c-badb-588951a98552 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:32.367459 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c518af97-2a0e-441c-badb-588951a98552 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:32.452672 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-c518af97-2a0e-441c-badb-588951a98552 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lazy-loading 'services' on Instance uuid 8b730dca-866b-4096-9175-6d27c3d35e55 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:23:32.526047 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c518af97-2a0e-441c-badb-588951a98552 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/os-volume_attachments/7b6a97e8-eb7a-4f0b-8b5c-5f30f1093449" status: 202 len: 0 microversion: 2.1 time: 0.299973 May 17 18:23:32.527046 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 356/655] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:23:32 2022] DELETE /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/os-volume_attachments/7b6a97e8-eb7a-4f0b-8b5c-5f30f1093449 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 18:23:32.792937 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5942ac46-c3d4-4001-a12d-f9b7552d6554 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:32.793481 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5942ac46-c3d4-4001-a12d-f9b7552d6554 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:32.799538 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5942ac46-c3d4-4001-a12d-f9b7552d6554 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:32.799992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5942ac46-c3d4-4001-a12d-f9b7552d6554 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:32.800764 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5942ac46-c3d4-4001-a12d-f9b7552d6554 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:32.801210 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5942ac46-c3d4-4001-a12d-f9b7552d6554 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:32.935016 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5942ac46-c3d4-4001-a12d-f9b7552d6554 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:32.944077 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5942ac46-c3d4-4001-a12d-f9b7552d6554 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:32.945720 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5942ac46-c3d4-4001-a12d-f9b7552d6554 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:32.946958 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5942ac46-c3d4-4001-a12d-f9b7552d6554 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.158582 May 17 18:23:32.957960 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 300/656] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:32 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:33.358468 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-832fabf8-5705-4835-aa27-a0e748007a9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:33.359399 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-832fabf8-5705-4835-aa27-a0e748007a9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:33.365738 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-832fabf8-5705-4835-aa27-a0e748007a9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:33.366187 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-832fabf8-5705-4835-aa27-a0e748007a9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:33.366996 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-832fabf8-5705-4835-aa27-a0e748007a9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:33.367432 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-832fabf8-5705-4835-aa27-a0e748007a9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:33.500589 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-832fabf8-5705-4835-aa27-a0e748007a9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:33.508532 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-832fabf8-5705-4835-aa27-a0e748007a9c tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.155887 May 17 18:23:33.509308 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 357/657] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:33 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:33.965782 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-825f8b12-7aca-498d-a1bc-02b5d1622aca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:33.966393 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-825f8b12-7aca-498d-a1bc-02b5d1622aca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:33.972793 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-825f8b12-7aca-498d-a1bc-02b5d1622aca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:33.973248 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-825f8b12-7aca-498d-a1bc-02b5d1622aca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:33.974044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-825f8b12-7aca-498d-a1bc-02b5d1622aca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:33.974483 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-825f8b12-7aca-498d-a1bc-02b5d1622aca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:34.141967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-825f8b12-7aca-498d-a1bc-02b5d1622aca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:34.150717 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-825f8b12-7aca-498d-a1bc-02b5d1622aca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:34.152799 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-825f8b12-7aca-498d-a1bc-02b5d1622aca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:34.154022 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-825f8b12-7aca-498d-a1bc-02b5d1622aca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.192681 May 17 18:23:34.161613 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 301/658] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:33 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:34.525785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f0765768-4ce8-47d9-bb37-8804783d6fd2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:34.526482 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f0765768-4ce8-47d9-bb37-8804783d6fd2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:34.532775 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f0765768-4ce8-47d9-bb37-8804783d6fd2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:34.533229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f0765768-4ce8-47d9-bb37-8804783d6fd2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:34.534028 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f0765768-4ce8-47d9-bb37-8804783d6fd2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:34.534466 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f0765768-4ce8-47d9-bb37-8804783d6fd2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:34.678168 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f0765768-4ce8-47d9-bb37-8804783d6fd2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:34.690293 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f0765768-4ce8-47d9-bb37-8804783d6fd2 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.168566 May 17 18:23:34.690865 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 358/659] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:34 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:35.172674 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-22c66b3c-229d-4ef1-84be-07e474a489b0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:35.173370 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-22c66b3c-229d-4ef1-84be-07e474a489b0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:35.179904 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-22c66b3c-229d-4ef1-84be-07e474a489b0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:35.180351 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-22c66b3c-229d-4ef1-84be-07e474a489b0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:35.181126 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-22c66b3c-229d-4ef1-84be-07e474a489b0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:35.181589 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-22c66b3c-229d-4ef1-84be-07e474a489b0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:35.321797 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-22c66b3c-229d-4ef1-84be-07e474a489b0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:35.330515 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-22c66b3c-229d-4ef1-84be-07e474a489b0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:35.332015 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-22c66b3c-229d-4ef1-84be-07e474a489b0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:35.333179 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-22c66b3c-229d-4ef1-84be-07e474a489b0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.164534 May 17 18:23:35.334054 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 302/660] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:35 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:35.708709 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fc5fc230-b43b-46e8-9264-4db9fa09d390 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:35.709500 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fc5fc230-b43b-46e8-9264-4db9fa09d390 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:35.717889 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fc5fc230-b43b-46e8-9264-4db9fa09d390 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:35.718656 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fc5fc230-b43b-46e8-9264-4db9fa09d390 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:35.719718 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fc5fc230-b43b-46e8-9264-4db9fa09d390 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:35.720235 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fc5fc230-b43b-46e8-9264-4db9fa09d390 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:35.868354 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fc5fc230-b43b-46e8-9264-4db9fa09d390 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:35.876469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fc5fc230-b43b-46e8-9264-4db9fa09d390 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.171652 May 17 18:23:35.877302 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 359/661] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:35 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:36.352708 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f8060d76-8197-4911-88be-d08ff25983d4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:36.353316 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f8060d76-8197-4911-88be-d08ff25983d4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:36.360466 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f8060d76-8197-4911-88be-d08ff25983d4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:36.360922 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f8060d76-8197-4911-88be-d08ff25983d4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:36.361722 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f8060d76-8197-4911-88be-d08ff25983d4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:36.362164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f8060d76-8197-4911-88be-d08ff25983d4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:36.493855 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f8060d76-8197-4911-88be-d08ff25983d4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:36.502911 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f8060d76-8197-4911-88be-d08ff25983d4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:36.504430 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f8060d76-8197-4911-88be-d08ff25983d4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:36.505705 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f8060d76-8197-4911-88be-d08ff25983d4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.156856 May 17 18:23:36.506274 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 303/662] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:36 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:36.894466 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-08df4a1c-a02a-474e-b583-cc693fd1b28d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:36.895111 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-08df4a1c-a02a-474e-b583-cc693fd1b28d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:36.902015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-08df4a1c-a02a-474e-b583-cc693fd1b28d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:36.902471 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-08df4a1c-a02a-474e-b583-cc693fd1b28d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:36.903285 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-08df4a1c-a02a-474e-b583-cc693fd1b28d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:36.903732 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-08df4a1c-a02a-474e-b583-cc693fd1b28d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:37.038129 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-08df4a1c-a02a-474e-b583-cc693fd1b28d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:37.047296 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-08df4a1c-a02a-474e-b583-cc693fd1b28d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.156716 May 17 18:23:37.047863 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 360/663] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:36 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:37.523809 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-75056166-285b-48dd-b766-a37898f32316 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:37.524440 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-75056166-285b-48dd-b766-a37898f32316 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:37.531406 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-75056166-285b-48dd-b766-a37898f32316 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:37.531864 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-75056166-285b-48dd-b766-a37898f32316 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:37.532656 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-75056166-285b-48dd-b766-a37898f32316 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:37.533104 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-75056166-285b-48dd-b766-a37898f32316 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:37.665753 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-75056166-285b-48dd-b766-a37898f32316 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:37.674242 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-75056166-285b-48dd-b766-a37898f32316 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:37.675792 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-75056166-285b-48dd-b766-a37898f32316 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:37.676955 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-75056166-285b-48dd-b766-a37898f32316 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.157056 May 17 18:23:37.677524 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 304/664] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:37 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:38.064144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f7e2dd9a-4597-4a14-8759-cba909e01e7d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:38.064719 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f7e2dd9a-4597-4a14-8759-cba909e01e7d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:38.070911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f7e2dd9a-4597-4a14-8759-cba909e01e7d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:38.071382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f7e2dd9a-4597-4a14-8759-cba909e01e7d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:38.072138 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f7e2dd9a-4597-4a14-8759-cba909e01e7d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:38.072627 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f7e2dd9a-4597-4a14-8759-cba909e01e7d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:38.194943 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f7e2dd9a-4597-4a14-8759-cba909e01e7d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:38.202971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f7e2dd9a-4597-4a14-8759-cba909e01e7d tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.142757 May 17 18:23:38.203522 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 361/665] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:38 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:38.695144 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1c2ab0c0-0d30-4d83-b924-7b0a2fc8eeea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:38.695772 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1c2ab0c0-0d30-4d83-b924-7b0a2fc8eeea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:38.702918 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1c2ab0c0-0d30-4d83-b924-7b0a2fc8eeea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:38.703374 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1c2ab0c0-0d30-4d83-b924-7b0a2fc8eeea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:38.704150 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1c2ab0c0-0d30-4d83-b924-7b0a2fc8eeea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:38.704596 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1c2ab0c0-0d30-4d83-b924-7b0a2fc8eeea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:38.831073 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1c2ab0c0-0d30-4d83-b924-7b0a2fc8eeea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:38.840292 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1c2ab0c0-0d30-4d83-b924-7b0a2fc8eeea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:38.841843 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1c2ab0c0-0d30-4d83-b924-7b0a2fc8eeea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:38.843028 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1c2ab0c0-0d30-4d83-b924-7b0a2fc8eeea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.151774 May 17 18:23:38.843581 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 305/666] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:38 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:39.219832 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-73dc9b7e-640f-4936-af3d-1eac7ec45574 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:39.220447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-73dc9b7e-640f-4936-af3d-1eac7ec45574 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:39.226741 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-73dc9b7e-640f-4936-af3d-1eac7ec45574 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:39.227196 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-73dc9b7e-640f-4936-af3d-1eac7ec45574 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:39.227966 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-73dc9b7e-640f-4936-af3d-1eac7ec45574 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:39.228428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-73dc9b7e-640f-4936-af3d-1eac7ec45574 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:39.351782 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-73dc9b7e-640f-4936-af3d-1eac7ec45574 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:39.359871 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-73dc9b7e-640f-4936-af3d-1eac7ec45574 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.143956 May 17 18:23:39.360428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 362/667] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:39 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:39.860969 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-54c8e6f0-6f74-483f-89fe-70fb0a4e092f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:39.861616 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-54c8e6f0-6f74-483f-89fe-70fb0a4e092f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:39.868489 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-54c8e6f0-6f74-483f-89fe-70fb0a4e092f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:39.868940 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-54c8e6f0-6f74-483f-89fe-70fb0a4e092f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:39.869795 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-54c8e6f0-6f74-483f-89fe-70fb0a4e092f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:39.870234 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-54c8e6f0-6f74-483f-89fe-70fb0a4e092f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:39.998948 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-54c8e6f0-6f74-483f-89fe-70fb0a4e092f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:40.007488 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-54c8e6f0-6f74-483f-89fe-70fb0a4e092f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:40.009007 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-54c8e6f0-6f74-483f-89fe-70fb0a4e092f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:40.010234 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-54c8e6f0-6f74-483f-89fe-70fb0a4e092f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.153194 May 17 18:23:40.010793 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 306/668] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:39 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:40.376863 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-65373877-958c-4ab8-a242-eeaf8e681d34 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:40.377405 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-65373877-958c-4ab8-a242-eeaf8e681d34 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:40.383789 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65373877-958c-4ab8-a242-eeaf8e681d34 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:40.384245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65373877-958c-4ab8-a242-eeaf8e681d34 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:40.385545 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65373877-958c-4ab8-a242-eeaf8e681d34 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:40.385989 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65373877-958c-4ab8-a242-eeaf8e681d34 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:40.507824 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-65373877-958c-4ab8-a242-eeaf8e681d34 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:40.516287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-65373877-958c-4ab8-a242-eeaf8e681d34 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.143321 May 17 18:23:40.516862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 363/669] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:40 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:41.029083 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8395d46d-505c-48ca-b6e3-f76f462c8d6a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:41.029716 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8395d46d-505c-48ca-b6e3-f76f462c8d6a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:41.035906 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8395d46d-505c-48ca-b6e3-f76f462c8d6a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:41.036353 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8395d46d-505c-48ca-b6e3-f76f462c8d6a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:41.037115 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8395d46d-505c-48ca-b6e3-f76f462c8d6a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:41.037572 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8395d46d-505c-48ca-b6e3-f76f462c8d6a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:41.162166 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8395d46d-505c-48ca-b6e3-f76f462c8d6a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:41.170287 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8395d46d-505c-48ca-b6e3-f76f462c8d6a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:41.172648 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8395d46d-505c-48ca-b6e3-f76f462c8d6a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:41.173882 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8395d46d-505c-48ca-b6e3-f76f462c8d6a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.149234 May 17 18:23:41.174468 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 307/670] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:41 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:41.533560 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f8662599-8e52-4c49-abf9-cfabbf2e404a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:41.534174 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f8662599-8e52-4c49-abf9-cfabbf2e404a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:41.540478 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f8662599-8e52-4c49-abf9-cfabbf2e404a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:41.540929 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f8662599-8e52-4c49-abf9-cfabbf2e404a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:41.542244 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f8662599-8e52-4c49-abf9-cfabbf2e404a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:41.542682 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f8662599-8e52-4c49-abf9-cfabbf2e404a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:41.670138 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f8662599-8e52-4c49-abf9-cfabbf2e404a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:41.677863 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f8662599-8e52-4c49-abf9-cfabbf2e404a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.148167 May 17 18:23:41.678428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 364/671] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:41 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:42.191994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-85f35626-a1a1-464e-9bb5-79eb1c9d7673 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:42.192638 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-85f35626-a1a1-464e-9bb5-79eb1c9d7673 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:42.199013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-85f35626-a1a1-464e-9bb5-79eb1c9d7673 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:42.199719 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-85f35626-a1a1-464e-9bb5-79eb1c9d7673 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:42.200496 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-85f35626-a1a1-464e-9bb5-79eb1c9d7673 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:42.200937 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-85f35626-a1a1-464e-9bb5-79eb1c9d7673 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:42.325128 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-85f35626-a1a1-464e-9bb5-79eb1c9d7673 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:42.333336 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-85f35626-a1a1-464e-9bb5-79eb1c9d7673 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:42.334861 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-85f35626-a1a1-464e-9bb5-79eb1c9d7673 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:42.336013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-85f35626-a1a1-464e-9bb5-79eb1c9d7673 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.147913 May 17 18:23:42.336570 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 308/672] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:42 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:42.695420 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-03682fc0-1834-404c-bbf4-c2c104aefbca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:42.696028 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-03682fc0-1834-404c-bbf4-c2c104aefbca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:42.703147 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-03682fc0-1834-404c-bbf4-c2c104aefbca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:42.703591 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-03682fc0-1834-404c-bbf4-c2c104aefbca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:42.704349 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-03682fc0-1834-404c-bbf4-c2c104aefbca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:42.704783 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-03682fc0-1834-404c-bbf4-c2c104aefbca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:42.860022 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-03682fc0-1834-404c-bbf4-c2c104aefbca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:42.867826 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-03682fc0-1834-404c-bbf4-c2c104aefbca tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.176257 May 17 18:23:42.868396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 365/673] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:42 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:43.355172 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6bf1b280-1297-4e92-a2ea-444b2397bbe3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:43.355781 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6bf1b280-1297-4e92-a2ea-444b2397bbe3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:43.362460 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6bf1b280-1297-4e92-a2ea-444b2397bbe3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:43.362914 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6bf1b280-1297-4e92-a2ea-444b2397bbe3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:43.363680 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6bf1b280-1297-4e92-a2ea-444b2397bbe3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:43.364114 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6bf1b280-1297-4e92-a2ea-444b2397bbe3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:43.494093 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6bf1b280-1297-4e92-a2ea-444b2397bbe3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:43.503039 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6bf1b280-1297-4e92-a2ea-444b2397bbe3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:43.504561 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6bf1b280-1297-4e92-a2ea-444b2397bbe3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:43.505760 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6bf1b280-1297-4e92-a2ea-444b2397bbe3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.154984 May 17 18:23:43.506322 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 309/674] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:43 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:43.885923 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d4d3c3e6-9539-4e12-ad79-365e17b97905 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:43.886540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d4d3c3e6-9539-4e12-ad79-365e17b97905 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:43.892824 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d4d3c3e6-9539-4e12-ad79-365e17b97905 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:43.893270 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d4d3c3e6-9539-4e12-ad79-365e17b97905 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:43.894065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d4d3c3e6-9539-4e12-ad79-365e17b97905 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:43.894500 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d4d3c3e6-9539-4e12-ad79-365e17b97905 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:44.019287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d4d3c3e6-9539-4e12-ad79-365e17b97905 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:44.027590 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d4d3c3e6-9539-4e12-ad79-365e17b97905 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.146065 May 17 18:23:44.028154 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 366/675] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:43 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:44.156191 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-78e13f38-4f14-443a-97d2-9a594823b897 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:44.161955 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-78e13f38-4f14-443a-97d2-9a594823b897 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:44.162407 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-78e13f38-4f14-443a-97d2-9a594823b897 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:44.183514 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-78e13f38-4f14-443a-97d2-9a594823b897 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Going to try to stop instance {{(pid=117099) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 17 18:23:44.225675 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-78e13f38-4f14-443a-97d2-9a594823b897 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "POST /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/action" status: 202 len: 0 microversion: 2.1 time: 0.073662 May 17 18:23:44.226263 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 310/676] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:23:44 2022] POST /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:23:44.234380 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9c6ad632-d523-4acd-9cd6-c035dfa4eb92 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:44.234999 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9c6ad632-d523-4acd-9cd6-c035dfa4eb92 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:44.241704 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9c6ad632-d523-4acd-9cd6-c035dfa4eb92 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:44.242311 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9c6ad632-d523-4acd-9cd6-c035dfa4eb92 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:44.243226 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9c6ad632-d523-4acd-9cd6-c035dfa4eb92 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:44.243668 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9c6ad632-d523-4acd-9cd6-c035dfa4eb92 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:44.371063 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9c6ad632-d523-4acd-9cd6-c035dfa4eb92 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:44.378841 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9c6ad632-d523-4acd-9cd6-c035dfa4eb92 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1723 microversion: 2.1 time: 0.148373 May 17 18:23:44.379397 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 367/677] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:44 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:44.524608 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b08a02f8-b709-4a8a-902c-ceb62b21c679 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:44.525308 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b08a02f8-b709-4a8a-902c-ceb62b21c679 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:44.531394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b08a02f8-b709-4a8a-902c-ceb62b21c679 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:44.531870 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b08a02f8-b709-4a8a-902c-ceb62b21c679 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:44.532632 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b08a02f8-b709-4a8a-902c-ceb62b21c679 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:44.533067 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b08a02f8-b709-4a8a-902c-ceb62b21c679 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:44.657396 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b08a02f8-b709-4a8a-902c-ceb62b21c679 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:44.665673 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b08a02f8-b709-4a8a-902c-ceb62b21c679 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:44.667758 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b08a02f8-b709-4a8a-902c-ceb62b21c679 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:44.668913 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b08a02f8-b709-4a8a-902c-ceb62b21c679 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.149018 May 17 18:23:44.669503 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 311/678] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:44 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:45.045408 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c13173e6-5f4c-4c25-9bca-24a8fc34b616 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:45.046049 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c13173e6-5f4c-4c25-9bca-24a8fc34b616 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:45.053919 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c13173e6-5f4c-4c25-9bca-24a8fc34b616 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:45.054380 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c13173e6-5f4c-4c25-9bca-24a8fc34b616 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:45.055194 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c13173e6-5f4c-4c25-9bca-24a8fc34b616 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:45.055635 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c13173e6-5f4c-4c25-9bca-24a8fc34b616 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:45.201491 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c13173e6-5f4c-4c25-9bca-24a8fc34b616 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:45.209290 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c13173e6-5f4c-4c25-9bca-24a8fc34b616 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.168726 May 17 18:23:45.209824 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 368/679] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:45 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:45.396057 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2f83447d-fc84-41a4-b4f7-44e0d55d2994 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:45.396705 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2f83447d-fc84-41a4-b4f7-44e0d55d2994 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:45.403224 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2f83447d-fc84-41a4-b4f7-44e0d55d2994 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:45.403679 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2f83447d-fc84-41a4-b4f7-44e0d55d2994 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:45.404457 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2f83447d-fc84-41a4-b4f7-44e0d55d2994 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:45.404957 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2f83447d-fc84-41a4-b4f7-44e0d55d2994 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:45.529768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2f83447d-fc84-41a4-b4f7-44e0d55d2994 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:45.537352 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2f83447d-fc84-41a4-b4f7-44e0d55d2994 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.145149 May 17 18:23:45.537961 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 312/680] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:45 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:45.686768 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b07a246d-749a-4cf3-9a8d-ed5df2dd9d49 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:45.687379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b07a246d-749a-4cf3-9a8d-ed5df2dd9d49 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:45.693719 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b07a246d-749a-4cf3-9a8d-ed5df2dd9d49 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:45.694168 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b07a246d-749a-4cf3-9a8d-ed5df2dd9d49 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:45.694932 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b07a246d-749a-4cf3-9a8d-ed5df2dd9d49 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:45.695363 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b07a246d-749a-4cf3-9a8d-ed5df2dd9d49 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:45.822141 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b07a246d-749a-4cf3-9a8d-ed5df2dd9d49 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:45.831413 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b07a246d-749a-4cf3-9a8d-ed5df2dd9d49 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:45.832906 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b07a246d-749a-4cf3-9a8d-ed5df2dd9d49 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:45.834084 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b07a246d-749a-4cf3-9a8d-ed5df2dd9d49 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.151198 May 17 18:23:45.834630 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 369/681] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:45 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:46.226840 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6b700337-e10a-487f-a8d0-82fa9a8091b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:46.227456 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6b700337-e10a-487f-a8d0-82fa9a8091b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:46.233970 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6b700337-e10a-487f-a8d0-82fa9a8091b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:46.234425 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6b700337-e10a-487f-a8d0-82fa9a8091b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:46.235196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6b700337-e10a-487f-a8d0-82fa9a8091b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:46.235637 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6b700337-e10a-487f-a8d0-82fa9a8091b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:46.361263 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6b700337-e10a-487f-a8d0-82fa9a8091b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:46.369061 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6b700337-e10a-487f-a8d0-82fa9a8091b0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1734 microversion: 2.1 time: 0.146108 May 17 18:23:46.370289 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 313/682] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:46 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:46.554875 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7c1030e4-341e-4f89-b5e7-c342f83cd581 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:46.555424 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7c1030e4-341e-4f89-b5e7-c342f83cd581 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:46.561778 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c1030e4-341e-4f89-b5e7-c342f83cd581 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:46.562230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c1030e4-341e-4f89-b5e7-c342f83cd581 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:46.562996 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c1030e4-341e-4f89-b5e7-c342f83cd581 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:46.563434 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c1030e4-341e-4f89-b5e7-c342f83cd581 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:46.689745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7c1030e4-341e-4f89-b5e7-c342f83cd581 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:46.697236 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7c1030e4-341e-4f89-b5e7-c342f83cd581 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.146240 May 17 18:23:46.698052 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 370/683] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:46 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:46.852121 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-97071bf2-544a-4f9f-9dfb-daeb60e4e279 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:46.852800 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-97071bf2-544a-4f9f-9dfb-daeb60e4e279 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:46.859218 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97071bf2-544a-4f9f-9dfb-daeb60e4e279 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:46.859676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97071bf2-544a-4f9f-9dfb-daeb60e4e279 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:46.860448 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97071bf2-544a-4f9f-9dfb-daeb60e4e279 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:46.860891 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97071bf2-544a-4f9f-9dfb-daeb60e4e279 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:46.984239 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-97071bf2-544a-4f9f-9dfb-daeb60e4e279 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:46.992430 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-97071bf2-544a-4f9f-9dfb-daeb60e4e279 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:46.994081 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-97071bf2-544a-4f9f-9dfb-daeb60e4e279 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:46.995239 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-97071bf2-544a-4f9f-9dfb-daeb60e4e279 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.147121 May 17 18:23:46.995804 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 314/684] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:46 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:47.387680 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-65953cee-6127-48ca-bf90-46c50626f274 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:47.388286 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-65953cee-6127-48ca-bf90-46c50626f274 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:47.394332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65953cee-6127-48ca-bf90-46c50626f274 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:47.394792 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65953cee-6127-48ca-bf90-46c50626f274 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:47.395536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65953cee-6127-48ca-bf90-46c50626f274 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:47.395997 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65953cee-6127-48ca-bf90-46c50626f274 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:47.519903 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-65953cee-6127-48ca-bf90-46c50626f274 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:47.527538 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-65953cee-6127-48ca-bf90-46c50626f274 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1714 microversion: 2.1 time: 0.144274 May 17 18:23:47.528100 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 371/685] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:47 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1714 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:47.581144 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ed60b9a7-89bd-45e9-9b09-e499cc938020 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:47.581678 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ed60b9a7-89bd-45e9-9b09-e499cc938020 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:47.587464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ed60b9a7-89bd-45e9-9b09-e499cc938020 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:47.587920 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ed60b9a7-89bd-45e9-9b09-e499cc938020 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:47.588687 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ed60b9a7-89bd-45e9-9b09-e499cc938020 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:47.589131 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ed60b9a7-89bd-45e9-9b09-e499cc938020 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:47.711829 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-ed60b9a7-89bd-45e9-9b09-e499cc938020 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] HTTP exception thrown: Cannot 'detach_volume' instance b94d1524-97f8-49d7-8685-184066d438d2 while it is in vm_state rescued May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ed60b9a7-89bd-45e9-9b09-e499cc938020 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Request method failure captured: May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: DELETE /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments/1c3070a6-2860-419f-b66a-26955e1758ad HTTP/1.1 May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bPT5PJb4v2TtchlazaTc4tsgElmPs7hEcTqQ-3XK5tZM_VLzGHdXJdr2rSJCb1gYx1SrW3nB-whM3bgmSozRTJNa1tqgL318uDZXw6jKtkeLg2QsgmksivrEql1pdoXv8CkKOVUB4re9ufg_nU903_wvc0E5GAJ53_vzIvqUBewKo May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: b7d713a65f9e4071988e5df2fbf90b17 May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:23:47.713416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:23:47.714860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:23:47.714860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:23:47.714860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: b7d713a65f9e4071988e5df2fbf90b17 May 17 18:23:47.714860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:23:47.714860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-ServerRescueNegativeTestJSON-510098100-project May 17 18:23:47.714860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:23:47.714860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:23:47.714860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 5e6f035cadd24a59803eec21c7b9e2c5 May 17 18:23:47.714860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-ServerRescueNegativeTestJSON-510098100-project May 17 18:23:47.714860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:23:47.714860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Cannot 'detach_volume' instance b94d1524-97f8-49d7-8685-184066d438d2 while it is in vm_state rescued May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'server_id': 'b94d1524-97f8-49d7-8685-184066d438d2', 'id': '1c3070a6-2860-419f-b66a-26955e1758ad'} May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance b94d1524-97f8-49d7-8685-184066d438d2 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:23:47.715562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance b94d1524-97f8-49d7-8685-184066d438d2 while it is in vm_state rescued May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance b94d1524-97f8-49d7-8685-184066d438d2 while it is in vm_state rescued May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:23:47.716867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ed60b9a7-89bd-45e9-9b09-e499cc938020 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Returning 409 to user: Cannot 'detach_volume' instance b94d1524-97f8-49d7-8685-184066d438d2 while it is in vm_state rescued {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:23:47.717904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cc066c7e-b994-498c-be13-3586a24cb05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:47.718322 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ed60b9a7-89bd-45e9-9b09-e499cc938020 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments/1c3070a6-2860-419f-b66a-26955e1758ad" status: 409 len: 152 microversion: 2.1 time: 0.137661 May 17 18:23:47.718322 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 315/686] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:23:47 2022] DELETE /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments/1c3070a6-2860-419f-b66a-26955e1758ad => generated 152 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 17 18:23:47.719091 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cc066c7e-b994-498c-be13-3586a24cb05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:47.722599 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc066c7e-b994-498c-be13-3586a24cb05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:47.722998 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc066c7e-b994-498c-be13-3586a24cb05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:47.723227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b0c1494e-3b6c-4d8d-ae36-ee8ebcfad05a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:47.723752 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b0c1494e-3b6c-4d8d-ae36-ee8ebcfad05a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:47.723854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc066c7e-b994-498c-be13-3586a24cb05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:47.724200 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc066c7e-b994-498c-be13-3586a24cb05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:47.730551 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0c1494e-3b6c-4d8d-ae36-ee8ebcfad05a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:47.731003 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0c1494e-3b6c-4d8d-ae36-ee8ebcfad05a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:47.731777 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0c1494e-3b6c-4d8d-ae36-ee8ebcfad05a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:47.732216 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0c1494e-3b6c-4d8d-ae36-ee8ebcfad05a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:47.799216 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b0c1494e-3b6c-4d8d-ae36-ee8ebcfad05a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "POST /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/action" status: 202 len: 0 microversion: 2.1 time: 0.079338 May 17 18:23:47.802991 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 316/687] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:23:47 2022] POST /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 18:23:47.809262 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1e6ed86a-5a14-44e2-be01-4f0420e348ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:47.809987 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1e6ed86a-5a14-44e2-be01-4f0420e348ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:47.816433 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e6ed86a-5a14-44e2-be01-4f0420e348ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:47.816890 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e6ed86a-5a14-44e2-be01-4f0420e348ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:47.817696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e6ed86a-5a14-44e2-be01-4f0420e348ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:47.818170 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1e6ed86a-5a14-44e2-be01-4f0420e348ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:47.884134 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cc066c7e-b994-498c-be13-3586a24cb05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:47.891776 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cc066c7e-b994-498c-be13-3586a24cb05a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.180777 May 17 18:23:47.899858 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 372/688] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:47 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:47.968744 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1e6ed86a-5a14-44e2-be01-4f0420e348ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:47.977135 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1e6ed86a-5a14-44e2-be01-4f0420e348ad tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1722 microversion: 2.1 time: 0.172438 May 17 18:23:47.977657 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 317/689] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:47 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:48.013756 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4c79dd52-46b4-4faf-8b89-9ecb1f35b3e7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:48.014405 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4c79dd52-46b4-4faf-8b89-9ecb1f35b3e7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:48.020892 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4c79dd52-46b4-4faf-8b89-9ecb1f35b3e7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:48.021340 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4c79dd52-46b4-4faf-8b89-9ecb1f35b3e7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:48.022149 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4c79dd52-46b4-4faf-8b89-9ecb1f35b3e7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:48.022647 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4c79dd52-46b4-4faf-8b89-9ecb1f35b3e7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:48.158017 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4c79dd52-46b4-4faf-8b89-9ecb1f35b3e7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:48.167048 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4c79dd52-46b4-4faf-8b89-9ecb1f35b3e7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:48.168561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4c79dd52-46b4-4faf-8b89-9ecb1f35b3e7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:48.169766 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4c79dd52-46b4-4faf-8b89-9ecb1f35b3e7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.160050 May 17 18:23:48.170321 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 373/690] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:48 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:48.909094 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2ae56bed-35f0-4e0c-9f94-282d0a44affb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:48.909684 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2ae56bed-35f0-4e0c-9f94-282d0a44affb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:48.916005 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2ae56bed-35f0-4e0c-9f94-282d0a44affb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:48.916459 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2ae56bed-35f0-4e0c-9f94-282d0a44affb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:48.917227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2ae56bed-35f0-4e0c-9f94-282d0a44affb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:48.917725 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2ae56bed-35f0-4e0c-9f94-282d0a44affb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:48.995495 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-da4ff4ca-c413-457c-86bd-ad84387b0c22 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:48.996188 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-da4ff4ca-c413-457c-86bd-ad84387b0c22 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:49.002653 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-da4ff4ca-c413-457c-86bd-ad84387b0c22 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:49.003388 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-da4ff4ca-c413-457c-86bd-ad84387b0c22 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:49.004173 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-da4ff4ca-c413-457c-86bd-ad84387b0c22 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:49.004618 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-da4ff4ca-c413-457c-86bd-ad84387b0c22 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:49.053810 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2ae56bed-35f0-4e0c-9f94-282d0a44affb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:49.061712 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2ae56bed-35f0-4e0c-9f94-282d0a44affb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.156543 May 17 18:23:49.062276 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 318/691] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:48 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:49.134262 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-da4ff4ca-c413-457c-86bd-ad84387b0c22 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:49.141924 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-da4ff4ca-c413-457c-86bd-ad84387b0c22 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1722 microversion: 2.1 time: 0.150749 May 17 18:23:49.142489 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 374/692] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:48 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:49.188314 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6e12d562-d358-4f07-851e-c583aceb030e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:49.188852 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6e12d562-d358-4f07-851e-c583aceb030e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:49.194706 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e12d562-d358-4f07-851e-c583aceb030e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:49.195154 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e12d562-d358-4f07-851e-c583aceb030e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:49.195922 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e12d562-d358-4f07-851e-c583aceb030e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:49.196395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e12d562-d358-4f07-851e-c583aceb030e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:49.553665 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6e12d562-d358-4f07-851e-c583aceb030e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:49.561894 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6e12d562-d358-4f07-851e-c583aceb030e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:49.563410 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6e12d562-d358-4f07-851e-c583aceb030e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:49.564564 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6e12d562-d358-4f07-851e-c583aceb030e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.380183 May 17 18:23:49.565115 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 319/693] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:49 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:50.079444 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b3ea2cbb-3398-44ef-8be0-f0e69392cf77 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:50.080486 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b3ea2cbb-3398-44ef-8be0-f0e69392cf77 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:50.087239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3ea2cbb-3398-44ef-8be0-f0e69392cf77 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:50.087698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3ea2cbb-3398-44ef-8be0-f0e69392cf77 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:50.089053 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3ea2cbb-3398-44ef-8be0-f0e69392cf77 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:50.089498 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3ea2cbb-3398-44ef-8be0-f0e69392cf77 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:50.159637 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4bfc709a-8cbb-4119-9127-5fa6fe112edf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:50.160920 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4bfc709a-8cbb-4119-9127-5fa6fe112edf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:50.169176 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bfc709a-8cbb-4119-9127-5fa6fe112edf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:50.169819 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bfc709a-8cbb-4119-9127-5fa6fe112edf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:50.170672 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bfc709a-8cbb-4119-9127-5fa6fe112edf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:50.171180 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bfc709a-8cbb-4119-9127-5fa6fe112edf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:50.261794 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b3ea2cbb-3398-44ef-8be0-f0e69392cf77 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:50.271369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b3ea2cbb-3398-44ef-8be0-f0e69392cf77 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.195467 May 17 18:23:50.272399 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 375/694] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:50 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:50.319436 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4bfc709a-8cbb-4119-9127-5fa6fe112edf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:50.328112 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4bfc709a-8cbb-4119-9127-5fa6fe112edf tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1722 microversion: 2.1 time: 0.172369 May 17 18:23:50.328692 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 320/695] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:50 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:50.583629 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-635e5084-f109-4e5f-b2a0-73b0734d341e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:50.584229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-635e5084-f109-4e5f-b2a0-73b0734d341e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:50.590434 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-635e5084-f109-4e5f-b2a0-73b0734d341e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:50.590880 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-635e5084-f109-4e5f-b2a0-73b0734d341e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:50.591635 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-635e5084-f109-4e5f-b2a0-73b0734d341e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:50.592069 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-635e5084-f109-4e5f-b2a0-73b0734d341e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:50.717071 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-635e5084-f109-4e5f-b2a0-73b0734d341e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:50.725208 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-635e5084-f109-4e5f-b2a0-73b0734d341e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:50.726733 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-635e5084-f109-4e5f-b2a0-73b0734d341e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:50.727923 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-635e5084-f109-4e5f-b2a0-73b0734d341e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.148657 May 17 18:23:50.728476 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 376/696] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:50 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:51.290234 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7f027716-8fbe-4140-b351-c89296e04a1e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:51.290843 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7f027716-8fbe-4140-b351-c89296e04a1e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:51.297751 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7f027716-8fbe-4140-b351-c89296e04a1e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:51.298201 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7f027716-8fbe-4140-b351-c89296e04a1e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:51.298964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7f027716-8fbe-4140-b351-c89296e04a1e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:51.299400 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7f027716-8fbe-4140-b351-c89296e04a1e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:51.345209 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6d8bc4d8-cb42-4e30-aa68-5d829bd41789 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:51.345895 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6d8bc4d8-cb42-4e30-aa68-5d829bd41789 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:51.352150 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d8bc4d8-cb42-4e30-aa68-5d829bd41789 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:51.352610 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d8bc4d8-cb42-4e30-aa68-5d829bd41789 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:51.353386 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d8bc4d8-cb42-4e30-aa68-5d829bd41789 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:51.353857 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d8bc4d8-cb42-4e30-aa68-5d829bd41789 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:51.469117 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7f027716-8fbe-4140-b351-c89296e04a1e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:51.478535 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7f027716-8fbe-4140-b351-c89296e04a1e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.191985 May 17 18:23:51.479118 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 321/697] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:51 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:51.513835 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6d8bc4d8-cb42-4e30-aa68-5d829bd41789 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:51.522044 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6d8bc4d8-cb42-4e30-aa68-5d829bd41789 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1722 microversion: 2.1 time: 0.180695 May 17 18:23:51.522622 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 377/698] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:51 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1722 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:51.546308 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-781271a2-2444-4121-9f19-593ee4a353bc req-3b988692-96be-44e4-9f53-e03a96019ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e", "name": "network-vif-plugged", "status": "completed", "tag": "06e106bb-68fb-497b-a3fb-dae45c0c334c"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:51.554689 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-781271a2-2444-4121-9f19-593ee4a353bc req-3b988692-96be-44e4-9f53-e03a96019ddb service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:51.555311 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-781271a2-2444-4121-9f19-593ee4a353bc req-3b988692-96be-44e4-9f53-e03a96019ddb service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:51.567417 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-781271a2-2444-4121-9f19-593ee4a353bc req-3b988692-96be-44e4-9f53-e03a96019ddb service nova] Creating event network-vif-plugged:06e106bb-68fb-497b-a3fb-dae45c0c334c for instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e on hv-cinder-83736 May 17 18:23:51.572935 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-781271a2-2444-4121-9f19-593ee4a353bc req-3b988692-96be-44e4-9f53-e03a96019ddb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030088 May 17 18:23:51.573624 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 322/699] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:23:51.746964 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-817c9888-9927-44c8-ae24-11f34fbfa0d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:51.747574 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-817c9888-9927-44c8-ae24-11f34fbfa0d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:51.753507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-817c9888-9927-44c8-ae24-11f34fbfa0d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:51.753962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-817c9888-9927-44c8-ae24-11f34fbfa0d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:51.754729 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-817c9888-9927-44c8-ae24-11f34fbfa0d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:51.755165 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-817c9888-9927-44c8-ae24-11f34fbfa0d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:51.882773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-817c9888-9927-44c8-ae24-11f34fbfa0d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:51.891899 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-817c9888-9927-44c8-ae24-11f34fbfa0d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:51.893409 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-817c9888-9927-44c8-ae24-11f34fbfa0d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:51.894595 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-817c9888-9927-44c8-ae24-11f34fbfa0d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.152107 May 17 18:23:51.895153 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 378/700] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:51 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:52.495889 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6ebbeb3d-3f51-495f-bc7f-03d8b70953bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:52.496506 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6ebbeb3d-3f51-495f-bc7f-03d8b70953bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:52.505078 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6ebbeb3d-3f51-495f-bc7f-03d8b70953bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:52.505639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6ebbeb3d-3f51-495f-bc7f-03d8b70953bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:52.506424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6ebbeb3d-3f51-495f-bc7f-03d8b70953bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:52.506864 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6ebbeb3d-3f51-495f-bc7f-03d8b70953bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:52.539707 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c6341ba9-38b7-4ee1-b57f-7846561b1aae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:52.540350 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c6341ba9-38b7-4ee1-b57f-7846561b1aae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:52.547376 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6341ba9-38b7-4ee1-b57f-7846561b1aae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:52.547839 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6341ba9-38b7-4ee1-b57f-7846561b1aae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:52.548616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6341ba9-38b7-4ee1-b57f-7846561b1aae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:52.549059 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6341ba9-38b7-4ee1-b57f-7846561b1aae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:52.677934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6ebbeb3d-3f51-495f-bc7f-03d8b70953bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:52.685326 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6ebbeb3d-3f51-495f-bc7f-03d8b70953bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.193749 May 17 18:23:52.685938 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 323/701] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:52 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:52.705861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c6341ba9-38b7-4ee1-b57f-7846561b1aae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:52.714106 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c6341ba9-38b7-4ee1-b57f-7846561b1aae tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1722 microversion: 2.1 time: 0.178212 May 17 18:23:52.714667 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 379/702] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:52 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:52.912707 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a71c061f-9ed0-49ed-b79b-1d06d5ff9fa4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:52.913991 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a71c061f-9ed0-49ed-b79b-1d06d5ff9fa4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:52.920185 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a71c061f-9ed0-49ed-b79b-1d06d5ff9fa4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:52.920646 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a71c061f-9ed0-49ed-b79b-1d06d5ff9fa4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:52.921537 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a71c061f-9ed0-49ed-b79b-1d06d5ff9fa4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:52.921986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a71c061f-9ed0-49ed-b79b-1d06d5ff9fa4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:53.051783 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a71c061f-9ed0-49ed-b79b-1d06d5ff9fa4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:53.059995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a71c061f-9ed0-49ed-b79b-1d06d5ff9fa4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:53.061534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a71c061f-9ed0-49ed-b79b-1d06d5ff9fa4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:53.062686 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a71c061f-9ed0-49ed-b79b-1d06d5ff9fa4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.154303 May 17 18:23:53.063242 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 324/703] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:52 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:53.703135 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-778f0ae8-5e0e-407d-8602-138caf8bb362 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:53.703746 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-778f0ae8-5e0e-407d-8602-138caf8bb362 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:53.710078 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-778f0ae8-5e0e-407d-8602-138caf8bb362 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:53.710555 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-778f0ae8-5e0e-407d-8602-138caf8bb362 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:53.711311 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-778f0ae8-5e0e-407d-8602-138caf8bb362 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:53.711747 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-778f0ae8-5e0e-407d-8602-138caf8bb362 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:53.730984 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6c361818-2588-4137-b300-b30d9141aa3a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:53.731601 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6c361818-2588-4137-b300-b30d9141aa3a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:53.737938 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6c361818-2588-4137-b300-b30d9141aa3a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:53.738402 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6c361818-2588-4137-b300-b30d9141aa3a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:53.739170 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6c361818-2588-4137-b300-b30d9141aa3a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:53.739610 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6c361818-2588-4137-b300-b30d9141aa3a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:53.903344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-778f0ae8-5e0e-407d-8602-138caf8bb362 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:53.910931 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-778f0ae8-5e0e-407d-8602-138caf8bb362 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.211899 May 17 18:23:53.912220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 380/704] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:53 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:53.913981 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6c361818-2588-4137-b300-b30d9141aa3a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:53.922202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6c361818-2588-4137-b300-b30d9141aa3a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1728 microversion: 2.1 time: 0.194996 May 17 18:23:53.922753 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 325/705] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:53 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:53.938640 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1b4e2214-8810-4196-b521-a8ebe0d9ec81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:53.939132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1b4e2214-8810-4196-b521-a8ebe0d9ec81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:53.944937 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b4e2214-8810-4196-b521-a8ebe0d9ec81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:53.945390 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b4e2214-8810-4196-b521-a8ebe0d9ec81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:53.946185 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b4e2214-8810-4196-b521-a8ebe0d9ec81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:53.946625 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b4e2214-8810-4196-b521-a8ebe0d9ec81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:54.023598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1b4e2214-8810-4196-b521-a8ebe0d9ec81 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088687 May 17 18:23:54.024236 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 381/706] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 17 18:23:53 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:23:54.081377 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6d8e08d7-6f1d-4ce3-83dd-e94424cd66d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:54.082045 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6d8e08d7-6f1d-4ce3-83dd-e94424cd66d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:54.088139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6d8e08d7-6f1d-4ce3-83dd-e94424cd66d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:54.088664 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6d8e08d7-6f1d-4ce3-83dd-e94424cd66d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:54.089575 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6d8e08d7-6f1d-4ce3-83dd-e94424cd66d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:54.090086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6d8e08d7-6f1d-4ce3-83dd-e94424cd66d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:54.317750 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6d8e08d7-6f1d-4ce3-83dd-e94424cd66d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:54.326715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6d8e08d7-6f1d-4ce3-83dd-e94424cd66d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:54.328218 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6d8e08d7-6f1d-4ce3-83dd-e94424cd66d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:54.329368 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6d8e08d7-6f1d-4ce3-83dd-e94424cd66d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.251985 May 17 18:23:54.332250 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 326/707] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:54 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:54.929011 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-04d3c285-fa2e-4684-a956-37641d66bb00 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:54.930247 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-04d3c285-fa2e-4684-a956-37641d66bb00 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:54.934118 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-ff5ab1ab-1664-4cc4-a1c4-91b3b6a698ec req-8df2de92-06f1-4bd1-ba64-b6f8e6819a03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94d1524-97f8-49d7-8685-184066d438d2", "tag": "08d646aa-87c5-4998-abe8-ddbc4d06f4f0"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:54.937055 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04d3c285-fa2e-4684-a956-37641d66bb00 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:54.937804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04d3c285-fa2e-4684-a956-37641d66bb00 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:54.938824 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04d3c285-fa2e-4684-a956-37641d66bb00 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:54.939729 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04d3c285-fa2e-4684-a956-37641d66bb00 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:54.946327 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-ff5ab1ab-1664-4cc4-a1c4-91b3b6a698ec req-8df2de92-06f1-4bd1-ba64-b6f8e6819a03 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:54.946791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-ff5ab1ab-1664-4cc4-a1c4-91b3b6a698ec req-8df2de92-06f1-4bd1-ba64-b6f8e6819a03 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:54.962574 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-ff5ab1ab-1664-4cc4-a1c4-91b3b6a698ec req-8df2de92-06f1-4bd1-ba64-b6f8e6819a03 service nova] Creating event network-changed:08d646aa-87c5-4998-abe8-ddbc4d06f4f0 for instance b94d1524-97f8-49d7-8685-184066d438d2 on hv-cinder-83736 May 17 18:23:54.968077 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-ff5ab1ab-1664-4cc4-a1c4-91b3b6a698ec req-8df2de92-06f1-4bd1-ba64-b6f8e6819a03 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039896 May 17 18:23:54.969600 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 327/708] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:23:55.070548 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-04d3c285-fa2e-4684-a956-37641d66bb00 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:55.078104 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-04d3c285-fa2e-4684-a956-37641d66bb00 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.153736 May 17 18:23:55.078665 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 382/709] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:54 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:55.350814 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1712c90b-c816-4e2f-aeed-42942a144d96 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:55.351882 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1712c90b-c816-4e2f-aeed-42942a144d96 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:55.358618 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1712c90b-c816-4e2f-aeed-42942a144d96 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:55.359076 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1712c90b-c816-4e2f-aeed-42942a144d96 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:55.359857 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1712c90b-c816-4e2f-aeed-42942a144d96 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:55.360354 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1712c90b-c816-4e2f-aeed-42942a144d96 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:55.495804 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1712c90b-c816-4e2f-aeed-42942a144d96 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:55.504978 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1712c90b-c816-4e2f-aeed-42942a144d96 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:55.506510 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1712c90b-c816-4e2f-aeed-42942a144d96 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:55.507806 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1712c90b-c816-4e2f-aeed-42942a144d96 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.161264 May 17 18:23:55.515834 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 328/710] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:55 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:56.095019 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c6f25f32-ad25-46d3-b96e-89c026928bce tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:56.095580 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c6f25f32-ad25-46d3-b96e-89c026928bce tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:56.101895 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6f25f32-ad25-46d3-b96e-89c026928bce tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:56.102338 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6f25f32-ad25-46d3-b96e-89c026928bce tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:56.103103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6f25f32-ad25-46d3-b96e-89c026928bce tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:56.103588 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6f25f32-ad25-46d3-b96e-89c026928bce tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:56.228250 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c6f25f32-ad25-46d3-b96e-89c026928bce tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:56.235452 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c6f25f32-ad25-46d3-b96e-89c026928bce tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.144398 May 17 18:23:56.236023 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 383/711] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:56 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:56.525389 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c1a197ff-fe7d-43df-8258-85521259a7dd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:56.526042 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c1a197ff-fe7d-43df-8258-85521259a7dd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:56.532792 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c1a197ff-fe7d-43df-8258-85521259a7dd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:56.533256 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c1a197ff-fe7d-43df-8258-85521259a7dd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:56.534345 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c1a197ff-fe7d-43df-8258-85521259a7dd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:56.534781 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c1a197ff-fe7d-43df-8258-85521259a7dd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:56.668140 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c1a197ff-fe7d-43df-8258-85521259a7dd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:56.676405 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c1a197ff-fe7d-43df-8258-85521259a7dd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:56.677915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c1a197ff-fe7d-43df-8258-85521259a7dd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:56.679063 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c1a197ff-fe7d-43df-8258-85521259a7dd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1809 microversion: 2.20 time: 0.157557 May 17 18:23:56.679617 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 329/712] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:56 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:56.984070 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-e2a1ab09-e0a7-47a6-803e-7c3dc5e055c8 req-5264a326-8476-441b-b9ff-86bfa909408e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94d1524-97f8-49d7-8685-184066d438d2", "tag": "08d646aa-87c5-4998-abe8-ddbc4d06f4f0"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:23:56.992034 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-e2a1ab09-e0a7-47a6-803e-7c3dc5e055c8 req-5264a326-8476-441b-b9ff-86bfa909408e service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:56.992471 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-e2a1ab09-e0a7-47a6-803e-7c3dc5e055c8 req-5264a326-8476-441b-b9ff-86bfa909408e service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:57.002966 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-e2a1ab09-e0a7-47a6-803e-7c3dc5e055c8 req-5264a326-8476-441b-b9ff-86bfa909408e service nova] Creating event network-changed:08d646aa-87c5-4998-abe8-ddbc4d06f4f0 for instance b94d1524-97f8-49d7-8685-184066d438d2 on hv-cinder-83736 May 17 18:23:57.007840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-e2a1ab09-e0a7-47a6-803e-7c3dc5e055c8 req-5264a326-8476-441b-b9ff-86bfa909408e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027464 May 17 18:23:57.008405 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 384/713] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:23:57.252302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-41484633-f5c6-4002-bd5b-ad6039550d43 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:57.252913 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-41484633-f5c6-4002-bd5b-ad6039550d43 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:57.259106 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-41484633-f5c6-4002-bd5b-ad6039550d43 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:57.259557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-41484633-f5c6-4002-bd5b-ad6039550d43 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:57.260315 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-41484633-f5c6-4002-bd5b-ad6039550d43 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:57.260752 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-41484633-f5c6-4002-bd5b-ad6039550d43 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:57.390254 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-41484633-f5c6-4002-bd5b-ad6039550d43 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:57.397551 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-41484633-f5c6-4002-bd5b-ad6039550d43 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.149056 May 17 18:23:57.398115 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 330/714] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:57 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:23:57.700156 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3af953ed-dce1-43d2-b544-3f3040c5bb70 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:57.701284 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3af953ed-dce1-43d2-b544-3f3040c5bb70 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:57.708620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3af953ed-dce1-43d2-b544-3f3040c5bb70 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:57.709075 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3af953ed-dce1-43d2-b544-3f3040c5bb70 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:57.709893 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3af953ed-dce1-43d2-b544-3f3040c5bb70 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:57.710330 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3af953ed-dce1-43d2-b544-3f3040c5bb70 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:57.836997 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3af953ed-dce1-43d2-b544-3f3040c5bb70 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:57.845496 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3af953ed-dce1-43d2-b544-3f3040c5bb70 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:57.847003 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3af953ed-dce1-43d2-b544-3f3040c5bb70 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:57.848168 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3af953ed-dce1-43d2-b544-3f3040c5bb70 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1796 microversion: 2.20 time: 0.153981 May 17 18:23:57.848716 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 385/715] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:23:57 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1796 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:23:58.415022 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a10876ff-428d-4a5b-b89e-43f4baebc37f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:58.415645 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a10876ff-428d-4a5b-b89e-43f4baebc37f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:58.422762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a10876ff-428d-4a5b-b89e-43f4baebc37f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:58.423222 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a10876ff-428d-4a5b-b89e-43f4baebc37f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:58.423996 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a10876ff-428d-4a5b-b89e-43f4baebc37f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:58.424461 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a10876ff-428d-4a5b-b89e-43f4baebc37f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:58.554281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a10876ff-428d-4a5b-b89e-43f4baebc37f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:58.562494 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a10876ff-428d-4a5b-b89e-43f4baebc37f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.151309 May 17 18:23:58.563072 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 331/716] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:58 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:23:59.580177 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1b851968-5dce-43ab-bfc4-6c113ab683c1 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:23:59.580780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1b851968-5dce-43ab-bfc4-6c113ab683c1 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:23:59.587373 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b851968-5dce-43ab-bfc4-6c113ab683c1 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:59.587823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b851968-5dce-43ab-bfc4-6c113ab683c1 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:59.588581 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b851968-5dce-43ab-bfc4-6c113ab683c1 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:23:59.589013 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1b851968-5dce-43ab-bfc4-6c113ab683c1 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:23:59.715149 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1b851968-5dce-43ab-bfc4-6c113ab683c1 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:23:59.722620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1b851968-5dce-43ab-bfc4-6c113ab683c1 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1677 microversion: 2.1 time: 0.146217 May 17 18:23:59.723173 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 386/717] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:23:59 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1677 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:00.740065 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-365e1771-c84e-4785-b193-6e8c0634fc8a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:00.740674 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-365e1771-c84e-4785-b193-6e8c0634fc8a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:00.747671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-365e1771-c84e-4785-b193-6e8c0634fc8a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:00.748118 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-365e1771-c84e-4785-b193-6e8c0634fc8a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:00.748879 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-365e1771-c84e-4785-b193-6e8c0634fc8a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:00.749316 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-365e1771-c84e-4785-b193-6e8c0634fc8a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:00.876198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-365e1771-c84e-4785-b193-6e8c0634fc8a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:00.883644 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-365e1771-c84e-4785-b193-6e8c0634fc8a tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1654 microversion: 2.1 time: 0.147435 May 17 18:24:00.884221 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 332/718] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:00 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1654 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:00.904288 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4635eb56-819d-4f7e-90f1-73a82f493c57 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:00.910740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4635eb56-819d-4f7e-90f1-73a82f493c57 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:00.911183 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4635eb56-819d-4f7e-90f1-73a82f493c57 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:00.932720 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4635eb56-819d-4f7e-90f1-73a82f493c57 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Going to try to start instance {{(pid=117098) start /opt/stack/nova/nova/compute/api.py:2730}} May 17 18:24:00.973379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4635eb56-819d-4f7e-90f1-73a82f493c57 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "POST /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/action" status: 202 len: 0 microversion: 2.1 time: 0.073226 May 17 18:24:00.974026 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 387/719] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:24:00 2022] POST /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:24:00.981995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-444ae349-7e7c-4b65-839d-1e9a6b9f6ce5 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:00.982775 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-444ae349-7e7c-4b65-839d-1e9a6b9f6ce5 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:00.989025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-444ae349-7e7c-4b65-839d-1e9a6b9f6ce5 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:00.989793 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-444ae349-7e7c-4b65-839d-1e9a6b9f6ce5 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:00.990633 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-444ae349-7e7c-4b65-839d-1e9a6b9f6ce5 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:00.991024 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-444ae349-7e7c-4b65-839d-1e9a6b9f6ce5 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:01.121789 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-444ae349-7e7c-4b65-839d-1e9a6b9f6ce5 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:01.129215 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-444ae349-7e7c-4b65-839d-1e9a6b9f6ce5 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1663 microversion: 2.1 time: 0.151056 May 17 18:24:01.129898 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 333/720] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:00 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1663 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:02.146644 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ba37c4d1-a69c-4145-b087-43cba6b696d3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:02.147349 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ba37c4d1-a69c-4145-b087-43cba6b696d3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:02.154151 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ba37c4d1-a69c-4145-b087-43cba6b696d3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:02.154600 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ba37c4d1-a69c-4145-b087-43cba6b696d3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:02.155375 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ba37c4d1-a69c-4145-b087-43cba6b696d3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:02.155792 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ba37c4d1-a69c-4145-b087-43cba6b696d3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:02.281011 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ba37c4d1-a69c-4145-b087-43cba6b696d3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:02.288291 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ba37c4d1-a69c-4145-b087-43cba6b696d3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1667 microversion: 2.1 time: 0.146354 May 17 18:24:02.288847 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 388/721] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:02 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1667 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:39.844952 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-01fddc69-6b1f-4a73-b377-3412ad9f966c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:39.845497 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-01fddc69-6b1f-4a73-b377-3412ad9f966c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:39.851640 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-01fddc69-6b1f-4a73-b377-3412ad9f966c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:39.852087 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-01fddc69-6b1f-4a73-b377-3412ad9f966c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:39.852853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-01fddc69-6b1f-4a73-b377-3412ad9f966c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:39.853292 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-01fddc69-6b1f-4a73-b377-3412ad9f966c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:39.878948 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-01fddc69-6b1f-4a73-b377-3412ad9f966c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:24:39.952134 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-01fddc69-6b1f-4a73-b377-3412ad9f966c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 204 len: 0 microversion: 2.1 time: 0.110656 May 17 18:24:39.952609 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 334/722] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:24:39 2022] DELETE /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:24:39.960828 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-23f2accb-5613-4970-8280-37c99ab1ec63 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:39.961447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-23f2accb-5613-4970-8280-37c99ab1ec63 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:39.968199 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-23f2accb-5613-4970-8280-37c99ab1ec63 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:39.968657 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-23f2accb-5613-4970-8280-37c99ab1ec63 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:39.969435 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-23f2accb-5613-4970-8280-37c99ab1ec63 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:39.969903 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-23f2accb-5613-4970-8280-37c99ab1ec63 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:40.097628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-23f2accb-5613-4970-8280-37c99ab1ec63 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:40.104917 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-23f2accb-5613-4970-8280-37c99ab1ec63 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1576 microversion: 2.1 time: 0.148002 May 17 18:24:40.105495 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 389/723] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:39 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1576 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:41.122650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6ca3f295-324a-4a14-8ff5-9c288442899a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:41.123288 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6ca3f295-324a-4a14-8ff5-9c288442899a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:41.129584 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6ca3f295-324a-4a14-8ff5-9c288442899a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:41.130093 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6ca3f295-324a-4a14-8ff5-9c288442899a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:41.130915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6ca3f295-324a-4a14-8ff5-9c288442899a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:41.131381 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6ca3f295-324a-4a14-8ff5-9c288442899a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:41.259745 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6ca3f295-324a-4a14-8ff5-9c288442899a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:41.267051 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6ca3f295-324a-4a14-8ff5-9c288442899a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1576 microversion: 2.1 time: 0.148689 May 17 18:24:41.267616 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 335/724] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:41 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:42.284193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b611a4ec-7003-4c37-b3e2-ada81afe2ed0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:42.284742 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b611a4ec-7003-4c37-b3e2-ada81afe2ed0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:42.291233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b611a4ec-7003-4c37-b3e2-ada81afe2ed0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:42.291687 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b611a4ec-7003-4c37-b3e2-ada81afe2ed0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:42.292954 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b611a4ec-7003-4c37-b3e2-ada81afe2ed0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:42.293391 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b611a4ec-7003-4c37-b3e2-ada81afe2ed0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:42.423505 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b611a4ec-7003-4c37-b3e2-ada81afe2ed0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:42.430988 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b611a4ec-7003-4c37-b3e2-ada81afe2ed0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1576 microversion: 2.1 time: 0.150826 May 17 18:24:42.431554 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 390/725] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:42 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1576 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:43.008958 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-6a748a9f-ffa6-45bb-a10c-8c5416d9c98e req-48e6333b-b5e7-4a24-acfc-8f595983c514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ef769ce-3ca7-4bbd-84dd-567ed0af61b9", "name": "network-vif-deleted", "tag": "14f3ea7b-33ca-4752-b87b-d34d49e5b90c"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:43.018393 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-6a748a9f-ffa6-45bb-a10c-8c5416d9c98e req-48e6333b-b5e7-4a24-acfc-8f595983c514 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:43.018844 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-6a748a9f-ffa6-45bb-a10c-8c5416d9c98e req-48e6333b-b5e7-4a24-acfc-8f595983c514 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:43.031022 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-6a748a9f-ffa6-45bb-a10c-8c5416d9c98e req-48e6333b-b5e7-4a24-acfc-8f595983c514 service nova] Creating event network-vif-deleted:14f3ea7b-33ca-4752-b87b-d34d49e5b90c for instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 on hv-cinder-83736 May 17 18:24:43.036771 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-6a748a9f-ffa6-45bb-a10c-8c5416d9c98e req-48e6333b-b5e7-4a24-acfc-8f595983c514 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031428 May 17 18:24:43.037899 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 336/726] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:24:43.448175 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1a1da52e-40b2-4eb7-b7f8-132ef3f8d6a3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:43.449388 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1a1da52e-40b2-4eb7-b7f8-132ef3f8d6a3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:43.456435 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1a1da52e-40b2-4eb7-b7f8-132ef3f8d6a3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:43.456894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1a1da52e-40b2-4eb7-b7f8-132ef3f8d6a3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:43.457713 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1a1da52e-40b2-4eb7-b7f8-132ef3f8d6a3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:43.458157 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1a1da52e-40b2-4eb7-b7f8-132ef3f8d6a3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:43.491651 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1a1da52e-40b2-4eb7-b7f8-132ef3f8d6a3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:43.492107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1a1da52e-40b2-4eb7-b7f8-132ef3f8d6a3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:43.492565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-1a1da52e-40b2-4eb7-b7f8-132ef3f8d6a3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lazy-loading 'fault' on Instance uuid 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:24:43.534781 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1a1da52e-40b2-4eb7-b7f8-132ef3f8d6a3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:43.542836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1a1da52e-40b2-4eb7-b7f8-132ef3f8d6a3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 200 len: 1228 microversion: 2.1 time: 0.098473 May 17 18:24:43.543416 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 391/727] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:43 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 1228 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:44.561593 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-820c72e0-e2e9-41f2-b18e-2a8e72614c06 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:44.562216 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-820c72e0-e2e9-41f2-b18e-2a8e72614c06 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:44.569675 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-820c72e0-e2e9-41f2-b18e-2a8e72614c06 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:44.570127 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-820c72e0-e2e9-41f2-b18e-2a8e72614c06 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:44.570900 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-820c72e0-e2e9-41f2-b18e-2a8e72614c06 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:44.571337 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-820c72e0-e2e9-41f2-b18e-2a8e72614c06 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:44.584685 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-820c72e0-e2e9-41f2-b18e-2a8e72614c06 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] HTTP exception thrown: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-820c72e0-e2e9-41f2-b18e-2a8e72614c06 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Request method failure captured: May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 HTTP/1.1 May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-eD2-mOxBg8kdJ2a8d8L1DGID6lAyLExl47UKOVPwO_QTVwUbKPH6dMMoVL0FVrY_s_D-diCFQzmtClEj5hCNMJ-_2la1rFQ2T8LVSbQaZl4blfqS64FHgF1s5aMJKgmOggo7FYdmgHXrOAhn-7j-2oSog42V8rJIReJ7ce66kdlTw May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 481c26193c6141588dd15fd5c593de86 May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-TestVolumeBootPattern-1473396945 May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:24:44.586330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_481c26193c6141588dd15fd5c593de86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/481c26193c6141588dd15fd5c593de86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/481c26193c6141588dd15fd5c593de86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/481c26193c6141588dd15fd5c593de86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-TestVolumeBootPattern-1473396945 May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 481c26193c6141588dd15fd5c593de86 May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473396945 May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-TestVolumeBootPattern-1473396945-project May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 861ad9a7c63a4d66a1806c4576cddce5 May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-TestVolumeBootPattern-1473396945-project May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:24:44.587950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '6ef769ce-3ca7-4bbd-84dd-567ed0af61b9'} May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:24:44.588896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:24:44.590409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:24:44.591711 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-820c72e0-e2e9-41f2-b18e-2a8e72614c06 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Returning 404 to user: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:24:44.591711 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-820c72e0-e2e9-41f2-b18e-2a8e72614c06 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 404 len: 111 microversion: 2.1 time: 0.031524 May 17 18:24:44.596536 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 337/728] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:44 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:24:44.680987 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-983511542", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63217234", "security_groups": [{"name": "tempest-secgroup-smoke-1126375773"}], "block_device_mapping_v2": [{"uuid": "25aba8ef-5fd6-4232-90b2-5df33578891a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "38c10630-122b-4079-98b2-93ad2511bb9a"}]}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:44.790697 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.network.neutron [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] validate_networks() for [('38c10630-122b-4079-98b2-93ad2511bb9a', None, None, None, None, None)] {{(pid=117098) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:24:45.171202 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Flavor limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:24:45.171660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Image limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:24:45.172267 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Flavor pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:24:45.172716 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Image pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:24:45.173132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:24:45.182757 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:45.183210 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:45.184028 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:45.184470 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:45.202672 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Getting quotas for project 481c26193c6141588dd15fd5c593de86. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:24:45.206777 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Getting quotas for user 861ad9a7c63a4d66a1806c4576cddce5 and project 481c26193c6141588dd15fd5c593de86. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:24:45.268512 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Going to run 1 instances... {{(pid=117098) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:24:45.270747 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25aba8ef-5fd6-4232-90b2-5df33578891a',volume_size=None,volume_type=None)] {{(pid=117098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:24:45.396925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fa731e6f-81a7-4a35-ba4b-93c7a2221bb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.720094 May 17 18:24:45.403201 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 392/729] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:24:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:24:45.408296 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ece7e1d9-fce0-4d0b-80d6-a9aa071dd36b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:45.408920 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ece7e1d9-fce0-4d0b-80d6-a9aa071dd36b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:45.477106 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ece7e1d9-fce0-4d0b-80d6-a9aa071dd36b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:45.492484 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ece7e1d9-fce0-4d0b-80d6-a9aa071dd36b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1092 microversion: 2.1 time: 0.088050 May 17 18:24:45.493055 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 338/730] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:45 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1092 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:46.509602 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-053ce422-9958-4838-a16d-100708acd9f3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:46.510217 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-053ce422-9958-4838-a16d-100708acd9f3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:46.516582 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-053ce422-9958-4838-a16d-100708acd9f3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:46.517032 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-053ce422-9958-4838-a16d-100708acd9f3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:46.517833 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-053ce422-9958-4838-a16d-100708acd9f3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:46.518269 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-053ce422-9958-4838-a16d-100708acd9f3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:46.579165 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-053ce422-9958-4838-a16d-100708acd9f3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:46.586590 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-053ce422-9958-4838-a16d-100708acd9f3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1208 microversion: 2.1 time: 0.081276 May 17 18:24:46.587213 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 393/731] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:46 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1208 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:47.570515 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-289ada91-5d21-4f54-b4e3-d501c535f168 req-1f2fe1d9-4d11-4d89-8e0b-8959bcc359e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e650c1f-7519-4407-8639-e1e14d479102", "tag": "0ec7785c-fbd9-442c-b93d-72558bcf9920"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:47.581964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-289ada91-5d21-4f54-b4e3-d501c535f168 req-1f2fe1d9-4d11-4d89-8e0b-8959bcc359e4 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:47.582698 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-289ada91-5d21-4f54-b4e3-d501c535f168 req-1f2fe1d9-4d11-4d89-8e0b-8959bcc359e4 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:47.594788 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-289ada91-5d21-4f54-b4e3-d501c535f168 req-1f2fe1d9-4d11-4d89-8e0b-8959bcc359e4 service nova] Creating event network-changed:0ec7785c-fbd9-442c-b93d-72558bcf9920 for instance 4e650c1f-7519-4407-8639-e1e14d479102 on hv-cinder-83736 May 17 18:24:47.604880 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1313c6b3-4a5f-413e-8c71-191d544a2005 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:47.605336 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1313c6b3-4a5f-413e-8c71-191d544a2005 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:47.609860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-289ada91-5d21-4f54-b4e3-d501c535f168 req-1f2fe1d9-4d11-4d89-8e0b-8959bcc359e4 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043378 May 17 18:24:47.610449 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 339/732] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:24:47.612079 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1313c6b3-4a5f-413e-8c71-191d544a2005 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:47.613078 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1313c6b3-4a5f-413e-8c71-191d544a2005 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:47.613941 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1313c6b3-4a5f-413e-8c71-191d544a2005 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:47.614537 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1313c6b3-4a5f-413e-8c71-191d544a2005 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:47.763035 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1313c6b3-4a5f-413e-8c71-191d544a2005 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:47.770344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1313c6b3-4a5f-413e-8c71-191d544a2005 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.170046 May 17 18:24:47.770908 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 394/733] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:47 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:24:48.788208 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-58ea6a92-94f5-4983-9960-89b549ec56fb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:48.788976 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-58ea6a92-94f5-4983-9960-89b549ec56fb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:48.795138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-58ea6a92-94f5-4983-9960-89b549ec56fb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:48.795595 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-58ea6a92-94f5-4983-9960-89b549ec56fb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:48.796366 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-58ea6a92-94f5-4983-9960-89b549ec56fb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:48.796808 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-58ea6a92-94f5-4983-9960-89b549ec56fb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:48.923049 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-58ea6a92-94f5-4983-9960-89b549ec56fb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:48.930337 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-58ea6a92-94f5-4983-9960-89b549ec56fb tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.146799 May 17 18:24:48.930904 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 340/734] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:48 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:49.371683 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cc166a25-c3b5-4b9b-8e21-79521eb02e43 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:49.372635 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cc166a25-c3b5-4b9b-8e21-79521eb02e43 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:49.378856 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc166a25-c3b5-4b9b-8e21-79521eb02e43 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:49.379304 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc166a25-c3b5-4b9b-8e21-79521eb02e43 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:49.380063 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc166a25-c3b5-4b9b-8e21-79521eb02e43 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:49.380496 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc166a25-c3b5-4b9b-8e21-79521eb02e43 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:49.451687 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cc166a25-c3b5-4b9b-8e21-79521eb02e43 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "POST /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/action" status: 202 len: 0 microversion: 2.1 time: 0.083415 May 17 18:24:49.452748 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 395/735] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:24:49 2022] POST /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:24:49.460515 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-111468a9-7186-41b5-a614-df4dd2d12cb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:49.461155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-111468a9-7186-41b5-a614-df4dd2d12cb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:49.468703 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-111468a9-7186-41b5-a614-df4dd2d12cb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:49.469392 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-111468a9-7186-41b5-a614-df4dd2d12cb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:49.470649 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-111468a9-7186-41b5-a614-df4dd2d12cb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:49.471092 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-111468a9-7186-41b5-a614-df4dd2d12cb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:49.619385 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-111468a9-7186-41b5-a614-df4dd2d12cb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:49.627163 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-111468a9-7186-41b5-a614-df4dd2d12cb8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1751 microversion: 2.1 time: 0.170538 May 17 18:24:49.627735 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 341/736] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:49 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:49.947990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5db41a9b-5a6d-4e54-bc73-f7cebb5ff859 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:49.948693 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5db41a9b-5a6d-4e54-bc73-f7cebb5ff859 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:49.954992 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5db41a9b-5a6d-4e54-bc73-f7cebb5ff859 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:49.955448 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5db41a9b-5a6d-4e54-bc73-f7cebb5ff859 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:49.956221 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5db41a9b-5a6d-4e54-bc73-f7cebb5ff859 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:49.956663 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5db41a9b-5a6d-4e54-bc73-f7cebb5ff859 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:50.086661 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5db41a9b-5a6d-4e54-bc73-f7cebb5ff859 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:50.094616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5db41a9b-5a6d-4e54-bc73-f7cebb5ff859 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.150905 May 17 18:24:50.095188 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 396/737] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:49 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:50.645240 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5a1ffec1-a448-4129-a3cd-476a639d736a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:50.645883 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5a1ffec1-a448-4129-a3cd-476a639d736a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:50.652426 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a1ffec1-a448-4129-a3cd-476a639d736a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:50.652880 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a1ffec1-a448-4129-a3cd-476a639d736a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:50.653689 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a1ffec1-a448-4129-a3cd-476a639d736a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:50.654131 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5a1ffec1-a448-4129-a3cd-476a639d736a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:50.791973 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5a1ffec1-a448-4129-a3cd-476a639d736a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:50.800189 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5a1ffec1-a448-4129-a3cd-476a639d736a tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.159198 May 17 18:24:50.800750 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 342/738] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:50 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:51.111568 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7a7e3bed-7882-4e56-8c09-c83139f39757 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:51.112115 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7a7e3bed-7882-4e56-8c09-c83139f39757 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:51.118404 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7a7e3bed-7882-4e56-8c09-c83139f39757 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.118861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7a7e3bed-7882-4e56-8c09-c83139f39757 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.119625 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7a7e3bed-7882-4e56-8c09-c83139f39757 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.120061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7a7e3bed-7882-4e56-8c09-c83139f39757 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.252980 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7a7e3bed-7882-4e56-8c09-c83139f39757 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:51.260328 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7a7e3bed-7882-4e56-8c09-c83139f39757 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.152740 May 17 18:24:51.260892 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 397/739] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:51 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:51.484633 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6c5eaaa9-f0ac-45e5-8eeb-880a5e3b6e24 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:51.485126 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6c5eaaa9-f0ac-45e5-8eeb-880a5e3b6e24 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:51.491196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6c5eaaa9-f0ac-45e5-8eeb-880a5e3b6e24 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.491653 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6c5eaaa9-f0ac-45e5-8eeb-880a5e3b6e24 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.492430 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6c5eaaa9-f0ac-45e5-8eeb-880a5e3b6e24 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.492915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6c5eaaa9-f0ac-45e5-8eeb-880a5e3b6e24 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.515863 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6c5eaaa9-f0ac-45e5-8eeb-880a5e3b6e24 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a/ips" status: 200 len: 149 microversion: 2.1 time: 0.035640 May 17 18:24:51.516422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 343/740] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 17 18:24:51 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:24:51.526840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7c86beb8-85b8-4fce-bf12-7d7dece438b7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb5ccbf2-0019-4baa-82bd-af51446cfe08"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:51.527965 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7c86beb8-85b8-4fce-bf12-7d7dece438b7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:51.534013 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c86beb8-85b8-4fce-bf12-7d7dece438b7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.534472 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c86beb8-85b8-4fce-bf12-7d7dece438b7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.535237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c86beb8-85b8-4fce-bf12-7d7dece438b7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.535673 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7c86beb8-85b8-4fce-bf12-7d7dece438b7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.615147 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-7c86beb8-85b8-4fce-bf12-7d7dece438b7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Invalid volume: volume cb5ccbf2-0019-4baa-82bd-af51446cfe08 is already attached to instances: 83f92bd0-84e7-4e4f-b596-c73c9453ce85 May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7c86beb8-85b8-4fce-bf12-7d7dece438b7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: POST /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a/os-volume_attachments HTTP/1.1 May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 74 May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:24:51.616864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {"volumeAttachment": {"volumeId": "cb5ccbf2-0019-4baa-82bd-af51446cfe08"}} May 17 18:24:51.618565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Invalid volume: volume cb5ccbf2-0019-4baa-82bd-af51446cfe08 is already attached to instances: 83f92bd0-84e7-4e4f-b596-c73c9453ce85 May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'server_id': 'cc177fc2-a93f-4490-8e44-0774f508720a', 'body': {'volumeAttachment': {'volumeId': 'cb5ccbf2-0019-4baa-82bd-af51446cfe08'}}} May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cb5ccbf2-0019-4baa-82bd-af51446cfe08 is already attached to instances: 83f92bd0-84e7-4e4f-b596-c73c9453ce85 May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:24:51.619485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cb5ccbf2-0019-4baa-82bd-af51446cfe08 is already attached to instances: 83f92bd0-84e7-4e4f-b596-c73c9453ce85 May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:24:51.620911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:24:51.622723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:24:51.622723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:24:51.622723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:24:51.622723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cb5ccbf2-0019-4baa-82bd-af51446cfe08 is already attached to instances: 83f92bd0-84e7-4e4f-b596-c73c9453ce85 May 17 18:24:51.622723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:24:51.622723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7c86beb8-85b8-4fce-bf12-7d7dece438b7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 400 to user: Invalid volume: volume cb5ccbf2-0019-4baa-82bd-af51446cfe08 is already attached to instances: 83f92bd0-84e7-4e4f-b596-c73c9453ce85 {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:24:51.622723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7c86beb8-85b8-4fce-bf12-7d7dece438b7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095464 May 17 18:24:51.622723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 398/741] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:24:51 2022] POST /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 18:24:51.627114 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6050eeff-9b50-4f55-b5ec-e86657374f55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:51.627616 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6050eeff-9b50-4f55-b5ec-e86657374f55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:51.633566 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6050eeff-9b50-4f55-b5ec-e86657374f55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.634026 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6050eeff-9b50-4f55-b5ec-e86657374f55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.634800 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6050eeff-9b50-4f55-b5ec-e86657374f55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.635244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6050eeff-9b50-4f55-b5ec-e86657374f55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.659892 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6050eeff-9b50-4f55-b5ec-e86657374f55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:24:51.735054 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6050eeff-9b50-4f55-b5ec-e86657374f55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 204 len: 0 microversion: 2.1 time: 0.111352 May 17 18:24:51.735554 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 344/742] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:24:51 2022] DELETE /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:24:51.743495 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-dc74db8a-fee7-4dc0-8d5e-1c1440b86807 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:51.744109 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-dc74db8a-fee7-4dc0-8d5e-1c1440b86807 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:51.751333 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dc74db8a-fee7-4dc0-8d5e-1c1440b86807 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.751786 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dc74db8a-fee7-4dc0-8d5e-1c1440b86807 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.752565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dc74db8a-fee7-4dc0-8d5e-1c1440b86807 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.753002 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dc74db8a-fee7-4dc0-8d5e-1c1440b86807 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.818298 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-cc93e0d3-04b3-459d-8e29-18bc7c190fbb tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:51.819007 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-cc93e0d3-04b3-459d-8e29-18bc7c190fbb tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:51.825952 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cc93e0d3-04b3-459d-8e29-18bc7c190fbb tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.826435 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cc93e0d3-04b3-459d-8e29-18bc7c190fbb tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.827211 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cc93e0d3-04b3-459d-8e29-18bc7c190fbb tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:51.827672 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cc93e0d3-04b3-459d-8e29-18bc7c190fbb tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:51.922624 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-dc74db8a-fee7-4dc0-8d5e-1c1440b86807 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:51.930093 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-dc74db8a-fee7-4dc0-8d5e-1c1440b86807 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1682 microversion: 2.1 time: 0.190412 May 17 18:24:51.930670 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 399/743] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:51 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:52.005101 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-cc93e0d3-04b3-459d-8e29-18bc7c190fbb tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:52.012797 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-cc93e0d3-04b3-459d-8e29-18bc7c190fbb tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.198733 May 17 18:24:52.013361 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 345/744] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:51 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:24:52.277030 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b42276c6-24d5-4448-99ea-5b94708aa454 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:52.277676 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b42276c6-24d5-4448-99ea-5b94708aa454 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:52.283809 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b42276c6-24d5-4448-99ea-5b94708aa454 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:52.284254 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b42276c6-24d5-4448-99ea-5b94708aa454 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:52.285184 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b42276c6-24d5-4448-99ea-5b94708aa454 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:52.285671 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b42276c6-24d5-4448-99ea-5b94708aa454 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:52.412415 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b42276c6-24d5-4448-99ea-5b94708aa454 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:52.420168 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b42276c6-24d5-4448-99ea-5b94708aa454 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.147306 May 17 18:24:52.420728 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 400/745] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:52 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:52.951785 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-466e0b97-d10f-45b7-8258-931d4816e7b9 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:52.952487 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-466e0b97-d10f-45b7-8258-931d4816e7b9 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:52.959016 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-466e0b97-d10f-45b7-8258-931d4816e7b9 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:52.959475 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-466e0b97-d10f-45b7-8258-931d4816e7b9 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:52.960267 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-466e0b97-d10f-45b7-8258-931d4816e7b9 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:52.960712 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-466e0b97-d10f-45b7-8258-931d4816e7b9 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:53.029919 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3992c72a-4b10-4b16-ab8f-92a4e9d730c9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:53.030542 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3992c72a-4b10-4b16-ab8f-92a4e9d730c9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:53.036895 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3992c72a-4b10-4b16-ab8f-92a4e9d730c9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:53.037352 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3992c72a-4b10-4b16-ab8f-92a4e9d730c9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:53.038173 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3992c72a-4b10-4b16-ab8f-92a4e9d730c9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:53.038616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3992c72a-4b10-4b16-ab8f-92a4e9d730c9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:53.228521 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-466e0b97-d10f-45b7-8258-931d4816e7b9 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:53.236799 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-466e0b97-d10f-45b7-8258-931d4816e7b9 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1682 microversion: 2.1 time: 0.289090 May 17 18:24:53.237373 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 346/746] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:52 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1682 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:53.294045 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3992c72a-4b10-4b16-ab8f-92a4e9d730c9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:53.302172 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3992c72a-4b10-4b16-ab8f-92a4e9d730c9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.276165 May 17 18:24:53.303782 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 401/747] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:53 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:24:53.438659 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-56d7748a-dffa-4c1c-8e14-3f2b98f81f17 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:53.439271 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-56d7748a-dffa-4c1c-8e14-3f2b98f81f17 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:53.445715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-56d7748a-dffa-4c1c-8e14-3f2b98f81f17 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:53.446164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-56d7748a-dffa-4c1c-8e14-3f2b98f81f17 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:53.446945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-56d7748a-dffa-4c1c-8e14-3f2b98f81f17 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:53.447385 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-56d7748a-dffa-4c1c-8e14-3f2b98f81f17 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:53.584460 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-56d7748a-dffa-4c1c-8e14-3f2b98f81f17 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:53.592344 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-56d7748a-dffa-4c1c-8e14-3f2b98f81f17 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.159493 May 17 18:24:53.592904 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 347/748] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:53 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:54.263237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4257c9ab-cf15-40de-9109-5db28c50a59b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:54.263853 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4257c9ab-cf15-40de-9109-5db28c50a59b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:54.270253 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4257c9ab-cf15-40de-9109-5db28c50a59b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:54.270704 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4257c9ab-cf15-40de-9109-5db28c50a59b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:54.271475 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4257c9ab-cf15-40de-9109-5db28c50a59b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:54.271917 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4257c9ab-cf15-40de-9109-5db28c50a59b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:54.319461 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d962fe39-3163-4c38-a9e0-7bc87e5696fa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:54.320086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d962fe39-3163-4c38-a9e0-7bc87e5696fa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:54.327064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d962fe39-3163-4c38-a9e0-7bc87e5696fa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:54.327508 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d962fe39-3163-4c38-a9e0-7bc87e5696fa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:54.328298 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d962fe39-3163-4c38-a9e0-7bc87e5696fa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:54.329714 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d962fe39-3163-4c38-a9e0-7bc87e5696fa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:54.340899 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4257c9ab-cf15-40de-9109-5db28c50a59b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:54.349263 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4257c9ab-cf15-40de-9109-5db28c50a59b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1614 microversion: 2.1 time: 0.089903 May 17 18:24:54.350102 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 402/749] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:54 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:54.390572 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-1ee9e683-f662-4106-9005-634ae9a0bf20 req-7191acf8-4464-455a-8c0b-fd60a1fd8f8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc177fc2-a93f-4490-8e44-0774f508720a", "name": "network-vif-deleted", "tag": "de8a891f-5a42-49e2-b6a3-15f94c53ec66"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:54.398569 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-1ee9e683-f662-4106-9005-634ae9a0bf20 req-7191acf8-4464-455a-8c0b-fd60a1fd8f8d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:54.399088 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-1ee9e683-f662-4106-9005-634ae9a0bf20 req-7191acf8-4464-455a-8c0b-fd60a1fd8f8d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:54.410397 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-1ee9e683-f662-4106-9005-634ae9a0bf20 req-7191acf8-4464-455a-8c0b-fd60a1fd8f8d service nova] Creating event network-vif-deleted:de8a891f-5a42-49e2-b6a3-15f94c53ec66 for instance cc177fc2-a93f-4490-8e44-0774f508720a on hv-cinder-83736 May 17 18:24:54.415573 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-1ee9e683-f662-4106-9005-634ae9a0bf20 req-7191acf8-4464-455a-8c0b-fd60a1fd8f8d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028682 May 17 18:24:54.416172 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 403/750] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:24:54.494845 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d962fe39-3163-4c38-a9e0-7bc87e5696fa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:54.503767 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d962fe39-3163-4c38-a9e0-7bc87e5696fa tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.188157 May 17 18:24:54.504581 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 348/751] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:54 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:54.609214 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9818a768-a195-491f-8a1b-c8a59686e8c8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:54.609944 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9818a768-a195-491f-8a1b-c8a59686e8c8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:54.615936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9818a768-a195-491f-8a1b-c8a59686e8c8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:54.616383 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9818a768-a195-491f-8a1b-c8a59686e8c8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:54.617153 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9818a768-a195-491f-8a1b-c8a59686e8c8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:54.617614 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9818a768-a195-491f-8a1b-c8a59686e8c8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:54.747401 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9818a768-a195-491f-8a1b-c8a59686e8c8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:54.754753 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9818a768-a195-491f-8a1b-c8a59686e8c8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.150291 May 17 18:24:54.755407 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 404/752] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:54 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:55.366849 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3a375d97-71bc-4f6a-b262-c7ad6c75f0c2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:55.367416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-3a375d97-71bc-4f6a-b262-c7ad6c75f0c2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:55.373793 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3a375d97-71bc-4f6a-b262-c7ad6c75f0c2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:55.374250 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3a375d97-71bc-4f6a-b262-c7ad6c75f0c2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:55.375019 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3a375d97-71bc-4f6a-b262-c7ad6c75f0c2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:55.375461 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3a375d97-71bc-4f6a-b262-c7ad6c75f0c2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:55.441365 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-3a375d97-71bc-4f6a-b262-c7ad6c75f0c2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:55.449112 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-3a375d97-71bc-4f6a-b262-c7ad6c75f0c2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 200 len: 1614 microversion: 2.1 time: 0.086155 May 17 18:24:55.450003 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 349/753] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:55 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 1614 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:55.520965 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-558e208f-0d3a-4375-b8c4-b8b7802b5593 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:55.521626 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-558e208f-0d3a-4375-b8c4-b8b7802b5593 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:55.528558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-558e208f-0d3a-4375-b8c4-b8b7802b5593 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:55.529016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-558e208f-0d3a-4375-b8c4-b8b7802b5593 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:55.529830 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-558e208f-0d3a-4375-b8c4-b8b7802b5593 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:55.530278 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-558e208f-0d3a-4375-b8c4-b8b7802b5593 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:55.670396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-558e208f-0d3a-4375-b8c4-b8b7802b5593 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:55.678608 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-558e208f-0d3a-4375-b8c4-b8b7802b5593 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.161554 May 17 18:24:55.679173 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 405/754] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:55 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:55.771868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-44e285c9-83e6-42d0-b214-a9f9959adeb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:55.772505 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-44e285c9-83e6-42d0-b214-a9f9959adeb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:55.778461 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-44e285c9-83e6-42d0-b214-a9f9959adeb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:55.778912 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-44e285c9-83e6-42d0-b214-a9f9959adeb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:55.779674 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-44e285c9-83e6-42d0-b214-a9f9959adeb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:55.780117 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-44e285c9-83e6-42d0-b214-a9f9959adeb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:55.909236 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-44e285c9-83e6-42d0-b214-a9f9959adeb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:55.917169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-44e285c9-83e6-42d0-b214-a9f9959adeb8 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.149059 May 17 18:24:55.918179 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 350/755] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:55 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:56.467604 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2329b3fc-2625-4cd8-a7ce-5ad95b8c2013 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:56.468218 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2329b3fc-2625-4cd8-a7ce-5ad95b8c2013 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:56.474203 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2329b3fc-2625-4cd8-a7ce-5ad95b8c2013 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:56.474650 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2329b3fc-2625-4cd8-a7ce-5ad95b8c2013 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:56.475410 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2329b3fc-2625-4cd8-a7ce-5ad95b8c2013 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:56.475838 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2329b3fc-2625-4cd8-a7ce-5ad95b8c2013 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:56.488643 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-2329b3fc-2625-4cd8-a7ce-5ad95b8c2013 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2329b3fc-2625-4cd8-a7ce-5ad95b8c2013 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a HTTP/1.1 May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:24:56.490265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:24:56.491819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': 'cc177fc2-a93f-4490-8e44-0774f508720a'} May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:24:56.492695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:24:56.494144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:24:56.495430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2329b3fc-2625-4cd8-a7ce-5ad95b8c2013 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:24:56.495430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2329b3fc-2625-4cd8-a7ce-5ad95b8c2013 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 404 len: 111 microversion: 2.1 time: 0.028552 May 17 18:24:56.495430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 406/756] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:56 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:24:56.500515 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0910abd3-aef1-40a2-84e5-d596e469c7e6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '.version_select at 0x7f4e60237430>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:56.518913 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0910abd3-aef1-40a2-84e5-d596e469c7e6 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614074586" status: 202 len: 0 microversion: 2.1 time: 0.022189 May 17 18:24:56.519467 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 351/757] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 17 18:24:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1614074586 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:24:56.696081 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c45869dc-9d79-465f-a7ae-f9b9834af22c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:56.696759 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c45869dc-9d79-465f-a7ae-f9b9834af22c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:56.704143 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c45869dc-9d79-465f-a7ae-f9b9834af22c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:56.704691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c45869dc-9d79-465f-a7ae-f9b9834af22c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:56.705540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c45869dc-9d79-465f-a7ae-f9b9834af22c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:56.705988 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c45869dc-9d79-465f-a7ae-f9b9834af22c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:56.847519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c45869dc-9d79-465f-a7ae-f9b9834af22c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:56.857271 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c45869dc-9d79-465f-a7ae-f9b9834af22c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.164895 May 17 18:24:56.857891 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 407/758] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:56 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:56.934800 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a6a01d15-5af8-40c1-99a4-90ebbfcd6231 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:56.935543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a6a01d15-5af8-40c1-99a4-90ebbfcd6231 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:56.941891 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6a01d15-5af8-40c1-99a4-90ebbfcd6231 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:56.942456 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6a01d15-5af8-40c1-99a4-90ebbfcd6231 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:56.943324 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6a01d15-5af8-40c1-99a4-90ebbfcd6231 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:56.943822 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6a01d15-5af8-40c1-99a4-90ebbfcd6231 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:57.080246 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a6a01d15-5af8-40c1-99a4-90ebbfcd6231 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:57.087582 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a6a01d15-5af8-40c1-99a4-90ebbfcd6231 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.156801 May 17 18:24:57.088147 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 352/759] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:56 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:57.341077 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-dd6b3f65-d8d1-48df-85fd-430c4bb6ad7d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:57.341544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-dd6b3f65-d8d1-48df-85fd-430c4bb6ad7d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:57.347591 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dd6b3f65-d8d1-48df-85fd-430c4bb6ad7d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:57.348053 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dd6b3f65-d8d1-48df-85fd-430c4bb6ad7d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:57.348830 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dd6b3f65-d8d1-48df-85fd-430c4bb6ad7d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:57.349273 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dd6b3f65-d8d1-48df-85fd-430c4bb6ad7d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:57.425471 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-dd6b3f65-d8d1-48df-85fd-430c4bb6ad7d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lazy-loading 'services' on Instance uuid 83f92bd0-84e7-4e4f-b596-c73c9453ce85 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:24:57.493218 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-dd6b3f65-d8d1-48df-85fd-430c4bb6ad7d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/os-volume_attachments/cb5ccbf2-0019-4baa-82bd-af51446cfe08" status: 202 len: 0 microversion: 2.1 time: 0.156565 May 17 18:24:57.493860 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 408/760] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:24:57 2022] DELETE /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/os-volume_attachments/cb5ccbf2-0019-4baa-82bd-af51446cfe08 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:24:57.502155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5c94a896-a407-4cd9-974c-5996e81d11e0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:57.503127 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5c94a896-a407-4cd9-974c-5996e81d11e0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:57.509511 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5c94a896-a407-4cd9-974c-5996e81d11e0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:57.510043 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5c94a896-a407-4cd9-974c-5996e81d11e0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:57.510880 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5c94a896-a407-4cd9-974c-5996e81d11e0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:57.511900 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5c94a896-a407-4cd9-974c-5996e81d11e0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:57.542109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5c94a896-a407-4cd9-974c-5996e81d11e0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 May 17 18:24:57.542613 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 353/761] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:24:57 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:24:57.875687 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-649dceff-d2de-4cd8-8788-ebbd28d8f88d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:57.876394 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-649dceff-d2de-4cd8-8788-ebbd28d8f88d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:57.882671 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-649dceff-d2de-4cd8-8788-ebbd28d8f88d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:57.883119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-649dceff-d2de-4cd8-8788-ebbd28d8f88d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:57.883884 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-649dceff-d2de-4cd8-8788-ebbd28d8f88d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:57.884317 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-649dceff-d2de-4cd8-8788-ebbd28d8f88d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:58.031788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-649dceff-d2de-4cd8-8788-ebbd28d8f88d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:58.039500 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-649dceff-d2de-4cd8-8788-ebbd28d8f88d tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.168643 May 17 18:24:58.040072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 409/762] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:57 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:58.104177 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f5c6c649-f51e-4567-87e7-517f00fb4359 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:58.105282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f5c6c649-f51e-4567-87e7-517f00fb4359 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:58.111301 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f5c6c649-f51e-4567-87e7-517f00fb4359 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:58.111757 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f5c6c649-f51e-4567-87e7-517f00fb4359 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:58.112550 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f5c6c649-f51e-4567-87e7-517f00fb4359 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:58.112992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f5c6c649-f51e-4567-87e7-517f00fb4359 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:58.252212 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f5c6c649-f51e-4567-87e7-517f00fb4359 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:58.259643 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f5c6c649-f51e-4567-87e7-517f00fb4359 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.159380 May 17 18:24:58.260293 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 354/763] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:58 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:58.553161 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fea8010e-3300-4338-b38b-5517a698fe30 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:58.554218 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fea8010e-3300-4338-b38b-5517a698fe30 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:58.560647 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fea8010e-3300-4338-b38b-5517a698fe30 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:58.561102 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fea8010e-3300-4338-b38b-5517a698fe30 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:58.561909 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fea8010e-3300-4338-b38b-5517a698fe30 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:58.562353 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fea8010e-3300-4338-b38b-5517a698fe30 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:58.590973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fea8010e-3300-4338-b38b-5517a698fe30 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041878 May 17 18:24:58.591508 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 410/764] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:24:58 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:24:58.647023 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-93aafac6-8803-4f0d-8ac0-17205e86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:58.647521 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-93aafac6-8803-4f0d-8ac0-17205e86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:58.653947 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-93aafac6-8803-4f0d-8ac0-17205e86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:58.654409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-93aafac6-8803-4f0d-8ac0-17205e86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:58.655188 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-93aafac6-8803-4f0d-8ac0-17205e86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:58.655640 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-93aafac6-8803-4f0d-8ac0-17205e86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:58.680752 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-93aafac6-8803-4f0d-8ac0-17205e86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:24:58.755669 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-93aafac6-8803-4f0d-8ac0-17205e86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 204 len: 0 microversion: 2.1 time: 0.112167 May 17 18:24:58.756244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 355/765] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:24:58 2022] DELETE /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:24:58.764207 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b55663c8-6a1f-4958-8df6-45e822a3c09e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:58.764819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b55663c8-6a1f-4958-8df6-45e822a3c09e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:58.770614 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b55663c8-6a1f-4958-8df6-45e822a3c09e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:58.771066 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b55663c8-6a1f-4958-8df6-45e822a3c09e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:58.771827 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b55663c8-6a1f-4958-8df6-45e822a3c09e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:58.772261 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b55663c8-6a1f-4958-8df6-45e822a3c09e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:58.896362 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b55663c8-6a1f-4958-8df6-45e822a3c09e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:58.903614 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b55663c8-6a1f-4958-8df6-45e822a3c09e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1680 microversion: 2.1 time: 0.143229 May 17 18:24:58.904219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 411/766] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:58 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1680 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:59.057568 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-97851c7b-abba-4748-bdb2-6088ee6d756c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:59.058862 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-97851c7b-abba-4748-bdb2-6088ee6d756c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:59.064705 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97851c7b-abba-4748-bdb2-6088ee6d756c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:59.065163 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97851c7b-abba-4748-bdb2-6088ee6d756c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:59.065959 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97851c7b-abba-4748-bdb2-6088ee6d756c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:59.066402 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-97851c7b-abba-4748-bdb2-6088ee6d756c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:59.204865 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-97851c7b-abba-4748-bdb2-6088ee6d756c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:59.212605 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-97851c7b-abba-4748-bdb2-6088ee6d756c tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.159303 May 17 18:24:59.213160 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 356/767] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:59 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:59.276203 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-46336518-7afb-4283-b010-013874dec61f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:59.276813 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-46336518-7afb-4283-b010-013874dec61f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:59.283182 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-46336518-7afb-4283-b010-013874dec61f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:59.283631 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-46336518-7afb-4283-b010-013874dec61f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:59.284388 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-46336518-7afb-4283-b010-013874dec61f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:59.284824 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-46336518-7afb-4283-b010-013874dec61f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:59.413307 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-46336518-7afb-4283-b010-013874dec61f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:24:59.421355 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-46336518-7afb-4283-b010-013874dec61f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.148932 May 17 18:24:59.421949 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 412/768] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:59 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:24:59.810358 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-f2f8f093-4ec2-40d3-b36f-60db62e9bb14 req-c6662860-7d55-4593-b551-fea1250356d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e650c1f-7519-4407-8639-e1e14d479102", "name": "network-vif-plugged", "status": "completed", "tag": "0ec7785c-fbd9-442c-b93d-72558bcf9920"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:24:59.818925 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f2f8f093-4ec2-40d3-b36f-60db62e9bb14 req-c6662860-7d55-4593-b551-fea1250356d9 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:59.819392 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f2f8f093-4ec2-40d3-b36f-60db62e9bb14 req-c6662860-7d55-4593-b551-fea1250356d9 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:59.837088 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-f2f8f093-4ec2-40d3-b36f-60db62e9bb14 req-c6662860-7d55-4593-b551-fea1250356d9 service nova] Creating event network-vif-plugged:0ec7785c-fbd9-442c-b93d-72558bcf9920 for instance 4e650c1f-7519-4407-8639-e1e14d479102 on hv-cinder-83736 May 17 18:24:59.845371 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-f2f8f093-4ec2-40d3-b36f-60db62e9bb14 req-c6662860-7d55-4593-b551-fea1250356d9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040099 May 17 18:24:59.846224 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 357/769] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:24:59.921072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cde3e387-3240-4597-bee6-460d05273f1d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:24:59.921894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cde3e387-3240-4597-bee6-460d05273f1d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:24:59.928483 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cde3e387-3240-4597-bee6-460d05273f1d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:59.928956 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cde3e387-3240-4597-bee6-460d05273f1d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:24:59.929844 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cde3e387-3240-4597-bee6-460d05273f1d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:24:59.930371 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cde3e387-3240-4597-bee6-460d05273f1d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:00.064316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cde3e387-3240-4597-bee6-460d05273f1d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:00.071819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cde3e387-3240-4597-bee6-460d05273f1d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1680 microversion: 2.1 time: 0.154754 May 17 18:25:00.072640 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 413/770] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:24:59 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:00.230573 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d49c92c3-0409-42a7-acac-cd5a98854f47 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:00.231666 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d49c92c3-0409-42a7-acac-cd5a98854f47 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:00.237709 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d49c92c3-0409-42a7-acac-cd5a98854f47 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:00.238159 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d49c92c3-0409-42a7-acac-cd5a98854f47 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:00.238923 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d49c92c3-0409-42a7-acac-cd5a98854f47 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:00.239359 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d49c92c3-0409-42a7-acac-cd5a98854f47 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:00.382817 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d49c92c3-0409-42a7-acac-cd5a98854f47 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:00.390674 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d49c92c3-0409-42a7-acac-cd5a98854f47 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.164399 May 17 18:25:00.391234 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 358/771] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:00 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:00.438914 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-49b67526-8e1f-42fe-be77-750438a321d3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:00.439555 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-49b67526-8e1f-42fe-be77-750438a321d3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:00.445602 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-49b67526-8e1f-42fe-be77-750438a321d3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:00.446061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-49b67526-8e1f-42fe-be77-750438a321d3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:00.446836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-49b67526-8e1f-42fe-be77-750438a321d3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:00.447266 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-49b67526-8e1f-42fe-be77-750438a321d3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:00.581812 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-49b67526-8e1f-42fe-be77-750438a321d3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:00.589298 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-49b67526-8e1f-42fe-be77-750438a321d3 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.155022 May 17 18:25:00.589901 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 414/772] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:00 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:00.708751 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-949bc621-117b-49fa-949f-46942a76d40a req-f31977b6-3e2e-4bd1-b36e-abe63cc8c99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f92bd0-84e7-4e4f-b596-c73c9453ce85", "name": "network-vif-deleted", "tag": "200d9682-a32c-4f1b-afac-5e03e64190d5"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:00.717501 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-949bc621-117b-49fa-949f-46942a76d40a req-f31977b6-3e2e-4bd1-b36e-abe63cc8c99d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:00.717942 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-949bc621-117b-49fa-949f-46942a76d40a req-f31977b6-3e2e-4bd1-b36e-abe63cc8c99d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:00.729401 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-949bc621-117b-49fa-949f-46942a76d40a req-f31977b6-3e2e-4bd1-b36e-abe63cc8c99d service nova] Creating event network-vif-deleted:200d9682-a32c-4f1b-afac-5e03e64190d5 for instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 on hv-cinder-83736 May 17 18:25:00.735254 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-949bc621-117b-49fa-949f-46942a76d40a req-f31977b6-3e2e-4bd1-b36e-abe63cc8c99d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030134 May 17 18:25:00.736078 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 359/773] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:01.090095 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4b5ce5cd-197d-4019-8ac1-85e82ca18150 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:01.091323 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4b5ce5cd-197d-4019-8ac1-85e82ca18150 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:01.097936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4b5ce5cd-197d-4019-8ac1-85e82ca18150 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:01.098385 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4b5ce5cd-197d-4019-8ac1-85e82ca18150 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:01.099155 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4b5ce5cd-197d-4019-8ac1-85e82ca18150 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:01.099609 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4b5ce5cd-197d-4019-8ac1-85e82ca18150 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:01.130093 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4b5ce5cd-197d-4019-8ac1-85e82ca18150 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:01.130544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4b5ce5cd-197d-4019-8ac1-85e82ca18150 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:01.130994 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-4b5ce5cd-197d-4019-8ac1-85e82ca18150 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lazy-loading 'fault' on Instance uuid 83f92bd0-84e7-4e4f-b596-c73c9453ce85 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:25:01.170613 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4b5ce5cd-197d-4019-8ac1-85e82ca18150 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:01.178197 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4b5ce5cd-197d-4019-8ac1-85e82ca18150 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1332 microversion: 2.1 time: 0.091952 May 17 18:25:01.178904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 415/774] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:01 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:01.408830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4fbfcbfb-e7ee-4f2d-ad61-c427d6418105 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:01.409553 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4fbfcbfb-e7ee-4f2d-ad61-c427d6418105 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:01.415544 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fbfcbfb-e7ee-4f2d-ad61-c427d6418105 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:01.415996 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fbfcbfb-e7ee-4f2d-ad61-c427d6418105 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:01.416791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fbfcbfb-e7ee-4f2d-ad61-c427d6418105 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:01.417228 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fbfcbfb-e7ee-4f2d-ad61-c427d6418105 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:01.607257 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-92620161-743e-4d7e-9f54-40a4e7cadf60 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:01.607884 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-92620161-743e-4d7e-9f54-40a4e7cadf60 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:01.614318 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-92620161-743e-4d7e-9f54-40a4e7cadf60 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:01.614768 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-92620161-743e-4d7e-9f54-40a4e7cadf60 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:01.615552 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-92620161-743e-4d7e-9f54-40a4e7cadf60 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:01.615990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-92620161-743e-4d7e-9f54-40a4e7cadf60 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:01.871205 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4fbfcbfb-e7ee-4f2d-ad61-c427d6418105 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:01.879447 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4fbfcbfb-e7ee-4f2d-ad61-c427d6418105 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.475415 May 17 18:25:01.880238 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 360/775] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:01 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:01.900201 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-92620161-743e-4d7e-9f54-40a4e7cadf60 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:01.907700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-92620161-743e-4d7e-9f54-40a4e7cadf60 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1264 microversion: 2.1 time: 0.304932 May 17 18:25:01.908206 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 416/776] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:01 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1264 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:25:02.195202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9e97364d-7b01-46a0-8786-a12023818ee3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:02.195749 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-9e97364d-7b01-46a0-8786-a12023818ee3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:02.202271 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9e97364d-7b01-46a0-8786-a12023818ee3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:02.202722 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9e97364d-7b01-46a0-8786-a12023818ee3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:02.203490 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9e97364d-7b01-46a0-8786-a12023818ee3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:02.203926 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9e97364d-7b01-46a0-8786-a12023818ee3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:02.237379 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9e97364d-7b01-46a0-8786-a12023818ee3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:02.237902 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9e97364d-7b01-46a0-8786-a12023818ee3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:02.238359 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-9e97364d-7b01-46a0-8786-a12023818ee3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lazy-loading 'fault' on Instance uuid 83f92bd0-84e7-4e4f-b596-c73c9453ce85 {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:25:02.283792 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-9e97364d-7b01-46a0-8786-a12023818ee3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:02.290939 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9e97364d-7b01-46a0-8786-a12023818ee3 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 200 len: 1332 microversion: 2.1 time: 0.099695 May 17 18:25:02.291499 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 361/777] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:02 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 1332 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:02.897338 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a7e2d7d6-a8fb-479a-959b-016668e19af9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:02.898061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a7e2d7d6-a8fb-479a-959b-016668e19af9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:02.904808 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a7e2d7d6-a8fb-479a-959b-016668e19af9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:02.905260 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a7e2d7d6-a8fb-479a-959b-016668e19af9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:02.906058 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a7e2d7d6-a8fb-479a-959b-016668e19af9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:02.906502 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a7e2d7d6-a8fb-479a-959b-016668e19af9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:02.924480 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5e4057d5-f58c-4031-bf3d-bcb13d8daf77 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:02.925101 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5e4057d5-f58c-4031-bf3d-bcb13d8daf77 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:02.931470 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5e4057d5-f58c-4031-bf3d-bcb13d8daf77 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:02.931922 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5e4057d5-f58c-4031-bf3d-bcb13d8daf77 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:02.932718 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5e4057d5-f58c-4031-bf3d-bcb13d8daf77 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:02.933158 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5e4057d5-f58c-4031-bf3d-bcb13d8daf77 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:03.114210 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a7e2d7d6-a8fb-479a-959b-016668e19af9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:03.117967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5e4057d5-f58c-4031-bf3d-bcb13d8daf77 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:03.122085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a7e2d7d6-a8fb-479a-959b-016668e19af9 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.228655 May 17 18:25:03.122662 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 417/778] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:02 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:03.125845 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5e4057d5-f58c-4031-bf3d-bcb13d8daf77 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1452 microversion: 2.1 time: 0.205096 May 17 18:25:03.126656 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 362/779] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:02 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1452 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:25:03.141007 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ae08ad03-e93b-4a9f-9640-c7b4e9eaeb1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:03.141655 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ae08ad03-e93b-4a9f-9640-c7b4e9eaeb1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:03.147382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ae08ad03-e93b-4a9f-9640-c7b4e9eaeb1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:03.147831 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ae08ad03-e93b-4a9f-9640-c7b4e9eaeb1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:03.148649 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ae08ad03-e93b-4a9f-9640-c7b4e9eaeb1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:03.149034 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ae08ad03-e93b-4a9f-9640-c7b4e9eaeb1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:03.275406 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ae08ad03-e93b-4a9f-9640-c7b4e9eaeb1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:03.283354 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ae08ad03-e93b-4a9f-9640-c7b4e9eaeb1f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1452 microversion: 2.1 time: 0.145934 May 17 18:25:03.283925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 418/780] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:03 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1452 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:03.308119 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ec1a1e1b-8065-4088-854b-abed77cfc509 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:03.308830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ec1a1e1b-8065-4088-854b-abed77cfc509 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:03.314757 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec1a1e1b-8065-4088-854b-abed77cfc509 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:03.315211 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec1a1e1b-8065-4088-854b-abed77cfc509 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:03.315983 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec1a1e1b-8065-4088-854b-abed77cfc509 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:03.316424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec1a1e1b-8065-4088-854b-abed77cfc509 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:03.330051 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-ec1a1e1b-8065-4088-854b-abed77cfc509 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ec1a1e1b-8065-4088-854b-abed77cfc509 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 HTTP/1.1 May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:25:03.331677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:25:03.333025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '83f92bd0-84e7-4e4f-b596-c73c9453ce85'} May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:25:03.333964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:25:03.335226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:25:03.336577 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ec1a1e1b-8065-4088-854b-abed77cfc509 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:25:03.336577 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ec1a1e1b-8065-4088-854b-abed77cfc509 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 404 len: 111 microversion: 2.1 time: 0.028790 May 17 18:25:03.336577 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 363/781] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:03 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:25:03.342445 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a53f4f26-ea69-4843-80c8-a1ec061d043d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '.version_select at 0x7f4e5b24aaf0>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:03.361294 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a53f4f26-ea69-4843-80c8-a1ec061d043d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198825939" status: 202 len: 0 microversion: 2.1 time: 0.023098 May 17 18:25:03.361928 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 419/782] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 17 18:25:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1198825939 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:25:03.939645 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-80a6d5f7-7130-45f7-b600-8de22b7741cb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: .version_select at 0x7f4e60256b80>, body: {"keypair": {"name": "tempest-keypair-661996070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBaADFFPnHTsmd50lqjGIJNZERri+5EsJoA6j9vz+l4dx7hSm8pNKRo0Uugz03UHB9UrgIlb9Lz4+walcB0cyMgDrm4WsT4Hs8CsnKd5wbFYJhPFnlIi5TK/NbQy/5w4A=="}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:03.954222 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-80a6d5f7-7130-45f7-b600-8de22b7741cb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'key_pairs'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:25:03.957986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-80a6d5f7-7130-45f7-b600-8de22b7741cb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for user 13b4ec46d3cb49faba3f063dcfd644c3 and project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'key_pairs'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:25:03.979926 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-80a6d5f7-7130-45f7-b600-8de22b7741cb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044196 May 17 18:25:03.980517 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 364/783] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 17 18:25:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:04.139220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f59d7299-ec6f-40ea-8a3f-79b34d716494 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:04.139842 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f59d7299-ec6f-40ea-8a3f-79b34d716494 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:04.148041 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f59d7299-ec6f-40ea-8a3f-79b34d716494 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:04.148722 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f59d7299-ec6f-40ea-8a3f-79b34d716494 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:04.149710 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f59d7299-ec6f-40ea-8a3f-79b34d716494 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:04.150446 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f59d7299-ec6f-40ea-8a3f-79b34d716494 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:04.384046 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f59d7299-ec6f-40ea-8a3f-79b34d716494 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:04.392997 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f59d7299-ec6f-40ea-8a3f-79b34d716494 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.257562 May 17 18:25:04.393865 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 420/784] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:04 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:05.008660 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-8f7ed423-2981-4d9e-a2b7-917cfc55a553 req-f2feb858-57a5-4f5c-b923-b4113926685c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e650c1f-7519-4407-8639-e1e14d479102", "tag": "0ec7785c-fbd9-442c-b93d-72558bcf9920"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:05.018129 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-8f7ed423-2981-4d9e-a2b7-917cfc55a553 req-f2feb858-57a5-4f5c-b923-b4113926685c service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.018683 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-8f7ed423-2981-4d9e-a2b7-917cfc55a553 req-f2feb858-57a5-4f5c-b923-b4113926685c service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.030362 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-8f7ed423-2981-4d9e-a2b7-917cfc55a553 req-f2feb858-57a5-4f5c-b923-b4113926685c service nova] Creating event network-changed:0ec7785c-fbd9-442c-b93d-72558bcf9920 for instance 4e650c1f-7519-4407-8639-e1e14d479102 on hv-cinder-83736 May 17 18:25:05.036960 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-8f7ed423-2981-4d9e-a2b7-917cfc55a553 req-f2feb858-57a5-4f5c-b923-b4113926685c service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031183 May 17 18:25:05.039712 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 365/785] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:05.178866 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-372980590", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bbec44d-dbfb-4f33-a578-9ea7e3744727"}], "security_groups": [{"name": "tempest-securitygroup--734950500"}], "key_name": "tempest-keypair-661996070", "user_data": "}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:05.259843 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-648df097-0067-4767-b63c-d110b84e3d43 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:05.260685 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-648df097-0067-4767-b63c-d110b84e3d43 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:05.268150 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-648df097-0067-4767-b63c-d110b84e3d43 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.268915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-648df097-0067-4767-b63c-d110b84e3d43 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.269980 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-648df097-0067-4767-b63c-d110b84e3d43 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.270523 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-648df097-0067-4767-b63c-d110b84e3d43 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.296109 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.network.neutron [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] validate_networks() for [('3bbec44d-dbfb-4f33-a578-9ea7e3744727', None, None, None, None, None)] {{(pid=117098) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:25:05.302293 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-648df097-0067-4767-b63c-d110b84e3d43 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments/611d0205-62b4-4cee-8e02-43b0389f1e0c" status: 200 len: 194 microversion: 2.20 time: 0.047447 May 17 18:25:05.302969 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 366/786] 10.222.0.65 () {60 vars in 1453 bytes} [Tue May 17 18:25:05 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments/611d0205-62b4-4cee-8e02-43b0389f1e0c => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:25:05.370606 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9a466fe5-9754-4a69-bd23-ef08de17c3db tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:05.371115 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-9a466fe5-9754-4a69-bd23-ef08de17c3db tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:05.377920 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9a466fe5-9754-4a69-bd23-ef08de17c3db tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.378597 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9a466fe5-9754-4a69-bd23-ef08de17c3db tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.379714 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9a466fe5-9754-4a69-bd23-ef08de17c3db tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.380509 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9a466fe5-9754-4a69-bd23-ef08de17c3db tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.486859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-9a466fe5-9754-4a69-bd23-ef08de17c3db tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lazy-loading 'services' on Instance uuid 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:25:05.621951 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9a466fe5-9754-4a69-bd23-ef08de17c3db tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments/611d0205-62b4-4cee-8e02-43b0389f1e0c" status: 202 len: 0 microversion: 2.20 time: 0.255199 May 17 18:25:05.622542 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 367/787] 10.222.0.65 () {60 vars in 1456 bytes} [Tue May 17 18:25:05 2022] DELETE /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments/611d0205-62b4-4cee-8e02-43b0389f1e0c => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 17 18:25:05.629586 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c737c04a-81a4-4f78-a885-71f085f39c55 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:05.630746 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c737c04a-81a4-4f78-a885-71f085f39c55 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:05.644944 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c737c04a-81a4-4f78-a885-71f085f39c55 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.645411 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c737c04a-81a4-4f78-a885-71f085f39c55 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.647179 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c737c04a-81a4-4f78-a885-71f085f39c55 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.647916 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c737c04a-81a4-4f78-a885-71f085f39c55 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.773873 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Flavor limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:25:05.774515 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Image limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:25:05.774985 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Flavor pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:25:05.775555 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Image pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:25:05.775968 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:25:05.796876 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.797344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.798787 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.799296 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.820344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:25:05.830190 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for user 13b4ec46d3cb49faba3f063dcfd644c3 and project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:25:05.842545 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Going to run 1 instances... {{(pid=117098) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:25:05.844860 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:25:05.860205 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c737c04a-81a4-4f78-a885-71f085f39c55 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:05.869255 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c737c04a-81a4-4f78-a885-71f085f39c55 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1756 microversion: 2.1 time: 0.245135 May 17 18:25:05.875005 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 368/788] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:05 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1756 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:05.880205 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-45db9ba7-5a27-46f4-955b-1cfb098d27d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:05.881182 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-45db9ba7-5a27-46f4-955b-1cfb098d27d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:05.888691 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-45db9ba7-5a27-46f4-955b-1cfb098d27d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.889158 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-45db9ba7-5a27-46f4-955b-1cfb098d27d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.889963 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-45db9ba7-5a27-46f4-955b-1cfb098d27d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:05.890408 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-45db9ba7-5a27-46f4-955b-1cfb098d27d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:05.901397 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a3246dc5-f9c3-4f1d-b699-6e35db240b6f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.727118 May 17 18:25:05.902092 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 421/789] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:25:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:25:05.912248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1763aa5b-7794-4f9e-a19a-38ea644ce373 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:05.913013 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1763aa5b-7794-4f9e-a19a-38ea644ce373 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:05.940574 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-45db9ba7-5a27-46f4-955b-1cfb098d27d1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064281 May 17 18:25:05.941330 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 369/790] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 17 18:25:05 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:25:05.996206 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1763aa5b-7794-4f9e-a19a-38ea644ce373 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:06.004493 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1763aa5b-7794-4f9e-a19a-38ea644ce373 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1240 microversion: 2.1 time: 0.096203 May 17 18:25:06.005291 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 422/791] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:05 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:06.887097 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-766be4ce-4b36-4a30-9c7f-4d0944cc1ae8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:06.888342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-766be4ce-4b36-4a30-9c7f-4d0944cc1ae8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:06.894333 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-766be4ce-4b36-4a30-9c7f-4d0944cc1ae8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:06.894787 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-766be4ce-4b36-4a30-9c7f-4d0944cc1ae8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:06.895556 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-766be4ce-4b36-4a30-9c7f-4d0944cc1ae8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:06.896011 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-766be4ce-4b36-4a30-9c7f-4d0944cc1ae8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:06.955376 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a764a0ab-4aa8-48c4-8bf8-8f93f7617fdb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:06.956964 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a764a0ab-4aa8-48c4-8bf8-8f93f7617fdb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:06.966438 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a764a0ab-4aa8-48c4-8bf8-8f93f7617fdb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:06.966991 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a764a0ab-4aa8-48c4-8bf8-8f93f7617fdb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:06.968349 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a764a0ab-4aa8-48c4-8bf8-8f93f7617fdb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:06.968860 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a764a0ab-4aa8-48c4-8bf8-8f93f7617fdb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:06.999255 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a764a0ab-4aa8-48c4-8bf8-8f93f7617fdb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050142 May 17 18:25:07.000515 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 423/792] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 17 18:25:06 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:25:07.022862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2da2b857-1964-4fe9-bb7c-47820a571819 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:07.023584 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2da2b857-1964-4fe9-bb7c-47820a571819 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:07.031043 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2da2b857-1964-4fe9-bb7c-47820a571819 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:07.031495 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2da2b857-1964-4fe9-bb7c-47820a571819 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:07.032497 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2da2b857-1964-4fe9-bb7c-47820a571819 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:07.032709 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2da2b857-1964-4fe9-bb7c-47820a571819 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:07.058727 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-766be4ce-4b36-4a30-9c7f-4d0944cc1ae8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:07.066971 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-766be4ce-4b36-4a30-9c7f-4d0944cc1ae8 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1759 microversion: 2.1 time: 0.183470 May 17 18:25:07.074314 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 370/793] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:06 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1759 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:07.100852 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2da2b857-1964-4fe9-bb7c-47820a571819 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:07.108404 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2da2b857-1964-4fe9-bb7c-47820a571819 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1292 microversion: 2.1 time: 0.089528 May 17 18:25:07.108973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 424/794] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:07 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:25:08.010904 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0cc66f9e-5d00-4eaa-87a6-fa79776c53ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:08.011943 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0cc66f9e-5d00-4eaa-87a6-fa79776c53ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:08.018715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0cc66f9e-5d00-4eaa-87a6-fa79776c53ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:08.019164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0cc66f9e-5d00-4eaa-87a6-fa79776c53ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:08.019933 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0cc66f9e-5d00-4eaa-87a6-fa79776c53ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:08.020372 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0cc66f9e-5d00-4eaa-87a6-fa79776c53ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:08.055821 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0cc66f9e-5d00-4eaa-87a6-fa79776c53ac tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048791 May 17 18:25:08.056700 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 371/795] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 17 18:25:08 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:08.120078 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b2724df6-54cd-4361-9b22-205e4791fe51 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:08.125853 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b2724df6-54cd-4361-9b22-205e4791fe51 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:08.126031 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-741e38aa-b73e-498f-b3ef-b4af49914354 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:08.127291 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-741e38aa-b73e-498f-b3ef-b4af49914354 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:08.134113 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b2724df6-54cd-4361-9b22-205e4791fe51 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:08.135197 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b2724df6-54cd-4361-9b22-205e4791fe51 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:08.136001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-741e38aa-b73e-498f-b3ef-b4af49914354 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:08.136541 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-741e38aa-b73e-498f-b3ef-b4af49914354 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:08.136879 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b2724df6-54cd-4361-9b22-205e4791fe51 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:08.138190 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-741e38aa-b73e-498f-b3ef-b4af49914354 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:08.138646 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-741e38aa-b73e-498f-b3ef-b4af49914354 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:08.138837 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b2724df6-54cd-4361-9b22-205e4791fe51 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:08.178197 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b2724df6-54cd-4361-9b22-205e4791fe51 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Going to try to terminate instance {{(pid=117098) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:25:08.281417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b2724df6-54cd-4361-9b22-205e4791fe51 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 204 len: 0 microversion: 2.20 time: 0.166535 May 17 18:25:08.282712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 425/796] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 17 18:25:08 2022] DELETE /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 18:25:08.293907 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-124c892f-cb82-4224-8376-a820e591897f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:08.294638 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-124c892f-cb82-4224-8376-a820e591897f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:08.295714 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-741e38aa-b73e-498f-b3ef-b4af49914354 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:08.300498 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-124c892f-cb82-4224-8376-a820e591897f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:08.300962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-124c892f-cb82-4224-8376-a820e591897f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:08.301782 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-124c892f-cb82-4224-8376-a820e591897f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:08.302452 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-124c892f-cb82-4224-8376-a820e591897f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:08.305184 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-741e38aa-b73e-498f-b3ef-b4af49914354 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1365 microversion: 2.1 time: 0.183623 May 17 18:25:08.305837 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 372/797] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:08 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:08.441505 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-124c892f-cb82-4224-8376-a820e591897f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:08.450264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-124c892f-cb82-4224-8376-a820e591897f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:08.451880 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-124c892f-cb82-4224-8376-a820e591897f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:08.453085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-124c892f-cb82-4224-8376-a820e591897f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.164448 May 17 18:25:08.453966 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 426/798] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:08 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:08.709107 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-6aef4df0-55ae-4465-8430-ece0cbad4483 req-b9cbc0d1-9c35-46eb-ba04-c25e7ccee098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5daec8-cf69-4eba-b4e1-6ded1a8cec02", "tag": "e1f657e8-cda2-47ce-8831-b51d319d4c42"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:08.718243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-6aef4df0-55ae-4465-8430-ece0cbad4483 req-b9cbc0d1-9c35-46eb-ba04-c25e7ccee098 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:08.718963 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-6aef4df0-55ae-4465-8430-ece0cbad4483 req-b9cbc0d1-9c35-46eb-ba04-c25e7ccee098 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:08.740369 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-6aef4df0-55ae-4465-8430-ece0cbad4483 req-b9cbc0d1-9c35-46eb-ba04-c25e7ccee098 service nova] Creating event network-changed:e1f657e8-cda2-47ce-8831-b51d319d4c42 for instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 on hv-cinder-83736 May 17 18:25:08.745660 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-6aef4df0-55ae-4465-8430-ece0cbad4483 req-b9cbc0d1-9c35-46eb-ba04-c25e7ccee098 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040291 May 17 18:25:08.746355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 373/799] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:09.323101 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-dca45171-7ee0-41d6-9ae6-3a1517d18008 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:09.323712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-dca45171-7ee0-41d6-9ae6-3a1517d18008 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:09.330520 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dca45171-7ee0-41d6-9ae6-3a1517d18008 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:09.330970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dca45171-7ee0-41d6-9ae6-3a1517d18008 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:09.331725 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dca45171-7ee0-41d6-9ae6-3a1517d18008 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:09.332158 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dca45171-7ee0-41d6-9ae6-3a1517d18008 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:09.460937 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-dca45171-7ee0-41d6-9ae6-3a1517d18008 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:09.471582 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-dca45171-7ee0-41d6-9ae6-3a1517d18008 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1365 microversion: 2.1 time: 0.151310 May 17 18:25:09.474276 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 427/800] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:09 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:09.475715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6e4f7661-d0a5-4cd0-83ff-33649a31f912 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:09.477125 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6e4f7661-d0a5-4cd0-83ff-33649a31f912 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:09.483850 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e4f7661-d0a5-4cd0-83ff-33649a31f912 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:09.484311 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e4f7661-d0a5-4cd0-83ff-33649a31f912 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:09.485100 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e4f7661-d0a5-4cd0-83ff-33649a31f912 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:09.485569 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6e4f7661-d0a5-4cd0-83ff-33649a31f912 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:09.612601 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6e4f7661-d0a5-4cd0-83ff-33649a31f912 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:09.620234 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6e4f7661-d0a5-4cd0-83ff-33649a31f912 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:09.622258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6e4f7661-d0a5-4cd0-83ff-33649a31f912 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:09.623400 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6e4f7661-d0a5-4cd0-83ff-33649a31f912 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.155626 May 17 18:25:09.623953 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 374/801] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:09 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:25:10.492118 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8c4b283d-3449-4f0e-9530-134569244184 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:10.492727 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-8c4b283d-3449-4f0e-9530-134569244184 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:10.498980 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8c4b283d-3449-4f0e-9530-134569244184 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:10.499430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8c4b283d-3449-4f0e-9530-134569244184 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:10.500189 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8c4b283d-3449-4f0e-9530-134569244184 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:10.500617 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8c4b283d-3449-4f0e-9530-134569244184 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:10.628691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8c4b283d-3449-4f0e-9530-134569244184 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:10.635959 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8c4b283d-3449-4f0e-9530-134569244184 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1365 microversion: 2.1 time: 0.147714 May 17 18:25:10.641218 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1a570475-a5e2-4b1d-a878-ecf1b99141b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:10.641862 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1a570475-a5e2-4b1d-a878-ecf1b99141b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:10.645249 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 428/802] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:10 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:10.648459 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1a570475-a5e2-4b1d-a878-ecf1b99141b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:10.648925 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1a570475-a5e2-4b1d-a878-ecf1b99141b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:10.649742 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1a570475-a5e2-4b1d-a878-ecf1b99141b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:10.650194 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1a570475-a5e2-4b1d-a878-ecf1b99141b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:10.780711 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1a570475-a5e2-4b1d-a878-ecf1b99141b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:10.788615 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1a570475-a5e2-4b1d-a878-ecf1b99141b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:10.790165 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1a570475-a5e2-4b1d-a878-ecf1b99141b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:10.791322 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1a570475-a5e2-4b1d-a878-ecf1b99141b7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1724 microversion: 2.20 time: 0.153877 May 17 18:25:10.791881 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 375/803] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:10 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:11.219508 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e2a144b9-a6ef-4db5-94ca-90fb86fb9e49 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:11.219994 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e2a144b9-a6ef-4db5-94ca-90fb86fb9e49 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:11.225819 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e2a144b9-a6ef-4db5-94ca-90fb86fb9e49 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:11.226268 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e2a144b9-a6ef-4db5-94ca-90fb86fb9e49 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:11.227036 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e2a144b9-a6ef-4db5-94ca-90fb86fb9e49 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:11.227655 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e2a144b9-a6ef-4db5-94ca-90fb86fb9e49 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:11.294761 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-691665d8-febf-4e97-a79d-d3a7381fdec0 req-5a26a54f-8647-4caf-a288-218bee702f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e", "name": "network-vif-deleted", "tag": "06e106bb-68fb-497b-a3fb-dae45c0c334c"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:11.303063 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-691665d8-febf-4e97-a79d-d3a7381fdec0 req-5a26a54f-8647-4caf-a288-218bee702f8b service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:11.303776 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-691665d8-febf-4e97-a79d-d3a7381fdec0 req-5a26a54f-8647-4caf-a288-218bee702f8b service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:11.310774 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-e2a144b9-a6ef-4db5-94ca-90fb86fb9e49 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lazy-loading 'services' on Instance uuid b94d1524-97f8-49d7-8685-184066d438d2 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:25:11.316044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-691665d8-febf-4e97-a79d-d3a7381fdec0 req-5a26a54f-8647-4caf-a288-218bee702f8b service nova] Creating event network-vif-deleted:06e106bb-68fb-497b-a3fb-dae45c0c334c for instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e on hv-cinder-83736 May 17 18:25:11.321182 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-691665d8-febf-4e97-a79d-d3a7381fdec0 req-5a26a54f-8647-4caf-a288-218bee702f8b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030084 May 17 18:25:11.321825 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 376/804] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:25:11.388130 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e2a144b9-a6ef-4db5-94ca-90fb86fb9e49 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments/1c3070a6-2860-419f-b66a-26955e1758ad" status: 202 len: 0 microversion: 2.1 time: 0.171858 May 17 18:25:11.388726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 429/805] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:25:11 2022] DELETE /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments/1c3070a6-2860-419f-b66a-26955e1758ad => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:25:11.397930 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ceb90d77-54ce-441b-93e7-3cd9f8772580 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:11.399346 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ceb90d77-54ce-441b-93e7-3cd9f8772580 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:11.409888 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ceb90d77-54ce-441b-93e7-3cd9f8772580 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:11.410343 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ceb90d77-54ce-441b-93e7-3cd9f8772580 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:11.411148 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ceb90d77-54ce-441b-93e7-3cd9f8772580 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:11.411578 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ceb90d77-54ce-441b-93e7-3cd9f8772580 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:11.442646 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ceb90d77-54ce-441b-93e7-3cd9f8772580 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049107 May 17 18:25:11.443407 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 377/806] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:25:11 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:11.663443 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-05d60e02-5509-404c-a1e1-fdfa9c64ad94 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:11.664145 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-05d60e02-5509-404c-a1e1-fdfa9c64ad94 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:11.670611 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-05d60e02-5509-404c-a1e1-fdfa9c64ad94 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:11.671067 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-05d60e02-5509-404c-a1e1-fdfa9c64ad94 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:11.671834 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-05d60e02-5509-404c-a1e1-fdfa9c64ad94 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:11.672271 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-05d60e02-5509-404c-a1e1-fdfa9c64ad94 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:11.800229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-05d60e02-5509-404c-a1e1-fdfa9c64ad94 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:11.807443 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-05d60e02-5509-404c-a1e1-fdfa9c64ad94 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1365 microversion: 2.1 time: 0.149046 May 17 18:25:11.808003 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 430/807] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:11 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:11.810854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0798944e-f5bb-46ce-8846-814d40bc8874 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:11.812035 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0798944e-f5bb-46ce-8846-814d40bc8874 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:11.818355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0798944e-f5bb-46ce-8846-814d40bc8874 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:11.818813 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0798944e-f5bb-46ce-8846-814d40bc8874 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:11.819602 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0798944e-f5bb-46ce-8846-814d40bc8874 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:11.820081 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0798944e-f5bb-46ce-8846-814d40bc8874 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:11.884494 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0798944e-f5bb-46ce-8846-814d40bc8874 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:11.893763 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0798944e-f5bb-46ce-8846-814d40bc8874 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:11.895264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0798944e-f5bb-46ce-8846-814d40bc8874 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:11.896419 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0798944e-f5bb-46ce-8846-814d40bc8874 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1656 microversion: 2.20 time: 0.090079 May 17 18:25:11.896973 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 378/808] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:11 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:12.455612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-009423f0-b2bf-4179-9add-a54ae6dbabdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:12.456644 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-009423f0-b2bf-4179-9add-a54ae6dbabdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:12.462617 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-009423f0-b2bf-4179-9add-a54ae6dbabdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:12.463075 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-009423f0-b2bf-4179-9add-a54ae6dbabdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:12.463847 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-009423f0-b2bf-4179-9add-a54ae6dbabdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:12.464289 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-009423f0-b2bf-4179-9add-a54ae6dbabdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:12.493300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-009423f0-b2bf-4179-9add-a54ae6dbabdc tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041684 May 17 18:25:12.493884 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 431/809] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:25:12 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:12.824112 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-17bb290c-dc04-4c36-b76b-a701f31648bc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:12.825227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-17bb290c-dc04-4c36-b76b-a701f31648bc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:12.831712 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-17bb290c-dc04-4c36-b76b-a701f31648bc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:12.832166 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-17bb290c-dc04-4c36-b76b-a701f31648bc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:12.832946 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-17bb290c-dc04-4c36-b76b-a701f31648bc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:12.833391 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-17bb290c-dc04-4c36-b76b-a701f31648bc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:12.914478 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a3c6bcaa-db1b-4914-b8a6-2a54957de5ff tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:12.915096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a3c6bcaa-db1b-4914-b8a6-2a54957de5ff tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:12.922081 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3c6bcaa-db1b-4914-b8a6-2a54957de5ff tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:12.922538 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3c6bcaa-db1b-4914-b8a6-2a54957de5ff tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:12.923312 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3c6bcaa-db1b-4914-b8a6-2a54957de5ff tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:12.923751 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3c6bcaa-db1b-4914-b8a6-2a54957de5ff tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:12.959602 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-17bb290c-dc04-4c36-b76b-a701f31648bc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:12.966883 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-17bb290c-dc04-4c36-b76b-a701f31648bc tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1365 microversion: 2.1 time: 0.146608 May 17 18:25:12.967457 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 379/810] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:12 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:12.986736 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a3c6bcaa-db1b-4914-b8a6-2a54957de5ff tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:12.994507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a3c6bcaa-db1b-4914-b8a6-2a54957de5ff tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:12.996005 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a3c6bcaa-db1b-4914-b8a6-2a54957de5ff tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:12.997845 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a3c6bcaa-db1b-4914-b8a6-2a54957de5ff tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1656 microversion: 2.20 time: 0.087220 May 17 18:25:12.998406 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 432/811] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:12 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1656 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:25:13.505423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-096e6cfc-a092-4cfc-8ab2-7606205ebe64 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:13.506391 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-096e6cfc-a092-4cfc-8ab2-7606205ebe64 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:13.513421 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-096e6cfc-a092-4cfc-8ab2-7606205ebe64 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:13.513911 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-096e6cfc-a092-4cfc-8ab2-7606205ebe64 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:13.514686 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-096e6cfc-a092-4cfc-8ab2-7606205ebe64 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:13.515132 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-096e6cfc-a092-4cfc-8ab2-7606205ebe64 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:13.546650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-096e6cfc-a092-4cfc-8ab2-7606205ebe64 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045483 May 17 18:25:13.550753 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 380/812] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:25:13 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:13.984618 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2e5dc3b9-7f0e-4639-917f-920592a940f1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:13.985229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2e5dc3b9-7f0e-4639-917f-920592a940f1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:13.991662 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2e5dc3b9-7f0e-4639-917f-920592a940f1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:13.992111 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2e5dc3b9-7f0e-4639-917f-920592a940f1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:13.992876 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2e5dc3b9-7f0e-4639-917f-920592a940f1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:13.993314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2e5dc3b9-7f0e-4639-917f-920592a940f1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.015680 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:14.016332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:14.024483 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:14.025281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.026130 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:14.026663 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.062421 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:14.063067 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.063643 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lazy-loading 'fault' on Instance uuid 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:25:14.120179 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:14.130114 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:14.132228 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:14.134011 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f9450706-11be-49d1-b930-410eb351bfb0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 200 len: 1371 microversion: 2.20 time: 0.122169 May 17 18:25:14.134723 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 381/813] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:14 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 1371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:25:14.154371 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2e5dc3b9-7f0e-4639-917f-920592a940f1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:14.161918 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2e5dc3b9-7f0e-4639-917f-920592a940f1 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1365 microversion: 2.1 time: 0.182097 May 17 18:25:14.162486 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 433/814] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:13 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:14.557527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3b4e1e22-fa76-4f25-9418-d7cf06315336 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:14.559245 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-3b4e1e22-fa76-4f25-9418-d7cf06315336 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:14.566365 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3b4e1e22-fa76-4f25-9418-d7cf06315336 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:14.566825 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3b4e1e22-fa76-4f25-9418-d7cf06315336 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.567637 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3b4e1e22-fa76-4f25-9418-d7cf06315336 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:14.568080 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3b4e1e22-fa76-4f25-9418-d7cf06315336 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.600359 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-3b4e1e22-fa76-4f25-9418-d7cf06315336 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046716 May 17 18:25:14.600923 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 382/815] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:25:14 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:25:14.681228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b60860b6-bf27-42f4-a612-55646e8e2a7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:14.681765 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b60860b6-bf27-42f4-a612-55646e8e2a7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:14.688349 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b60860b6-bf27-42f4-a612-55646e8e2a7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:14.688794 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b60860b6-bf27-42f4-a612-55646e8e2a7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.689585 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b60860b6-bf27-42f4-a612-55646e8e2a7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:14.690023 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b60860b6-bf27-42f4-a612-55646e8e2a7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.715896 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b60860b6-bf27-42f4-a612-55646e8e2a7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Going to try to terminate instance {{(pid=117098) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:25:14.788418 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b60860b6-bf27-42f4-a612-55646e8e2a7b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "DELETE /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 204 len: 0 microversion: 2.1 time: 0.110681 May 17 18:25:14.789261 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 434/816] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:25:14 2022] DELETE /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:25:14.799030 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d9eaa392-e563-4577-9ebe-1eafb26b5742 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:14.799644 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d9eaa392-e563-4577-9ebe-1eafb26b5742 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:14.805412 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d9eaa392-e563-4577-9ebe-1eafb26b5742 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:14.805899 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d9eaa392-e563-4577-9ebe-1eafb26b5742 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.806662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d9eaa392-e563-4577-9ebe-1eafb26b5742 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:14.807107 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d9eaa392-e563-4577-9ebe-1eafb26b5742 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:14.932018 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d9eaa392-e563-4577-9ebe-1eafb26b5742 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:14.939225 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d9eaa392-e563-4577-9ebe-1eafb26b5742 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1688 microversion: 2.1 time: 0.145172 May 17 18:25:14.939781 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 383/817] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:14 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:15.153958 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9bb4dd32-118f-4be5-9e52-387a9cf03fb3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:15.154660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9bb4dd32-118f-4be5-9e52-387a9cf03fb3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:15.160914 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9bb4dd32-118f-4be5-9e52-387a9cf03fb3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:15.161367 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9bb4dd32-118f-4be5-9e52-387a9cf03fb3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:15.162171 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9bb4dd32-118f-4be5-9e52-387a9cf03fb3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:15.162625 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9bb4dd32-118f-4be5-9e52-387a9cf03fb3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:15.176342 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-9bb4dd32-118f-4be5-9e52-387a9cf03fb3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] HTTP exception thrown: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9bb4dd32-118f-4be5-9e52-387a9cf03fb3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Request method failure captured: May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e HTTP/1.1 May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bK_hOAEprE3oTWKa7r9mpzFeKqR2YiQrXPb_nYxrUjafgbuUscHxCOZkewPOnyx5KXWGAzCg3iw0QiTz98BPc82zAy0s6IKGlcdfpOd-zJnvRkRIQdFaAN9X8iTTNpNKD2KLAhj09pcMT_ww2c1S9lZrXPoFkKn5vKJRI7lYwB4_Q May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:25:15.177990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 43620937739e45d3bb7849f98d0e6cce May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:25:15.179369 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e'} May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:25:15.180148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:25:15.181378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:15.182569 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c826b3f4-cfde-46ca-bf4a-ff18262d9574 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:15.183001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9bb4dd32-118f-4be5-9e52-387a9cf03fb3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Returning 404 to user: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:25:15.183105 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c826b3f4-cfde-46ca-bf4a-ff18262d9574 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:15.183253 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9bb4dd32-118f-4be5-9e52-387a9cf03fb3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 404 len: 111 microversion: 2.20 time: 0.030251 May 17 18:25:15.183253 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 435/818] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:15 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 18:25:15.185689 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c826b3f4-cfde-46ca-bf4a-ff18262d9574 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:15.186136 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c826b3f4-cfde-46ca-bf4a-ff18262d9574 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:15.186898 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c826b3f4-cfde-46ca-bf4a-ff18262d9574 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:15.187522 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c826b3f4-cfde-46ca-bf4a-ff18262d9574 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:15.188370 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-64d6bab6-ec48-439e-9beb-59fc9451566f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '.version_select at 0x7f4e5b1db820>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:15.206299 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-64d6bab6-ec48-439e-9beb-59fc9451566f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1787987943" status: 204 len: 0 microversion: 2.20 time: 0.021632 May 17 18:25:15.206885 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 436/819] 10.222.0.65 () {60 vars in 1261 bytes} [Tue May 17 18:25:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1787987943 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 18:25:15.376235 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c826b3f4-cfde-46ca-bf4a-ff18262d9574 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:15.383481 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c826b3f4-cfde-46ca-bf4a-ff18262d9574 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1365 microversion: 2.1 time: 0.208818 May 17 18:25:15.384046 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 384/820] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:15 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:25:15.850038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-65b87176-c298-466e-85c3-5397f25cdeec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Action: 'create', calling method: .version_select at 0x7f4e5b26dc10>, body: {"keypair": {"name": "tempest-keypair-1543471697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMfhQ9HaivclLXkHMU/L746A8kW4qt2uGPlW4dEt3ws9t59vHt+lbYTxamh1XaJ3Su/efJgw4NzqKF4OYw4osRmZO9XAKkqh2djNBNP6UCk3ZMY1Pu2uyNzj1oMXlkU+2g=="}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:15.864789 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-65b87176-c298-466e-85c3-5397f25cdeec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Getting quotas for project 379adfd2520a4d2dba04fca7fa3a1d95. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:25:15.868622 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-65b87176-c298-466e-85c3-5397f25cdeec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Getting quotas for user 43620937739e45d3bb7849f98d0e6cce and project 379adfd2520a4d2dba04fca7fa3a1d95. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:25:15.891025 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-65b87176-c298-466e-85c3-5397f25cdeec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.044849 May 17 18:25:15.891659 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 437/821] 10.222.0.65 () {62 vars in 1199 bytes} [Tue May 17 18:25:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 17 18:25:15.956955 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4fa6cbe3-7418-4b6e-89dd-9803a1f893fe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:15.957489 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4fa6cbe3-7418-4b6e-89dd-9803a1f893fe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:15.963596 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fa6cbe3-7418-4b6e-89dd-9803a1f893fe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:15.964050 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fa6cbe3-7418-4b6e-89dd-9803a1f893fe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:15.965636 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fa6cbe3-7418-4b6e-89dd-9803a1f893fe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:15.966092 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4fa6cbe3-7418-4b6e-89dd-9803a1f893fe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:16.109121 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4fa6cbe3-7418-4b6e-89dd-9803a1f893fe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:16.118060 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4fa6cbe3-7418-4b6e-89dd-9803a1f893fe tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1688 microversion: 2.1 time: 0.165053 May 17 18:25:16.118641 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 385/822] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:15 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:16.400623 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2809a802-7c10-437d-ac1d-2692fd2b9b7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:16.401427 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2809a802-7c10-437d-ac1d-2692fd2b9b7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:16.407411 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2809a802-7c10-437d-ac1d-2692fd2b9b7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:16.407984 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2809a802-7c10-437d-ac1d-2692fd2b9b7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:16.408872 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2809a802-7c10-437d-ac1d-2692fd2b9b7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:16.409613 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2809a802-7c10-437d-ac1d-2692fd2b9b7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:16.544332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2809a802-7c10-437d-ac1d-2692fd2b9b7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:16.551620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2809a802-7c10-437d-ac1d-2692fd2b9b7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1365 microversion: 2.1 time: 0.155365 May 17 18:25:16.552179 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 438/823] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:16 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:17.015805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-156740209", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6640be3d-e392-4726-8d89-eb40f1262219"}], "security_groups": [{"name": "tempest-securitygroup--426906904"}], "key_name": "tempest-keypair-1543471697", "user_data": "}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:17.112416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] validate_networks() for [('6640be3d-e392-4726-8d89-eb40f1262219', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:25:17.135207 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5652a460-74db-4c2d-bf69-4c329ae90302 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:17.135832 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5652a460-74db-4c2d-bf69-4c329ae90302 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:17.141643 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5652a460-74db-4c2d-bf69-4c329ae90302 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:17.142101 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5652a460-74db-4c2d-bf69-4c329ae90302 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:17.142880 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5652a460-74db-4c2d-bf69-4c329ae90302 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:17.143320 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5652a460-74db-4c2d-bf69-4c329ae90302 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:17.563263 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5652a460-74db-4c2d-bf69-4c329ae90302 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:17.570670 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5652a460-74db-4c2d-bf69-4c329ae90302 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1688 microversion: 2.1 time: 0.439318 May 17 18:25:17.571253 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 439/824] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:17 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1688 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:25:17.576691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5d891979-4ed3-4da8-b07e-4074cfbc994d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:17.577306 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5d891979-4ed3-4da8-b07e-4074cfbc994d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:17.582949 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5d891979-4ed3-4da8-b07e-4074cfbc994d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:17.583406 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5d891979-4ed3-4da8-b07e-4074cfbc994d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:17.584181 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5d891979-4ed3-4da8-b07e-4074cfbc994d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:17.584626 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5d891979-4ed3-4da8-b07e-4074cfbc994d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:17.780113 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5d891979-4ed3-4da8-b07e-4074cfbc994d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:17.787430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5d891979-4ed3-4da8-b07e-4074cfbc994d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1365 microversion: 2.1 time: 0.215221 May 17 18:25:17.788060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 440/825] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:17 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:17.842306 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:25:17.842830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:25:17.843380 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:25:17.844052 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:25:17.844450 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:25:17.853555 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:17.854146 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:17.854962 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:17.855403 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:17.872079 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Getting quotas for project 379adfd2520a4d2dba04fca7fa3a1d95. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:25:17.875955 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Getting quotas for user 43620937739e45d3bb7849f98d0e6cce and project 379adfd2520a4d2dba04fca7fa3a1d95. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:25:17.887555 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:25:17.889881 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:25:17.917402 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-fa68a05b-048e-4947-bb83-bfe8a7d58eee req-99601b89-b931-47cc-8bc0-940c94baaceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5daec8-cf69-4eba-b4e1-6ded1a8cec02", "name": "network-vif-plugged", "status": "completed", "tag": "e1f657e8-cda2-47ce-8831-b51d319d4c42"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:17.927392 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-fa68a05b-048e-4947-bb83-bfe8a7d58eee req-99601b89-b931-47cc-8bc0-940c94baaceb service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:17.928016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-fa68a05b-048e-4947-bb83-bfe8a7d58eee req-99601b89-b931-47cc-8bc0-940c94baaceb service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:17.939979 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-bcbe6643-6382-4020-ad23-782c031663ca tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.928476 May 17 18:25:17.941608 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 386/826] 10.222.0.65 () {62 vars in 1187 bytes} [Tue May 17 18:25:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 17 18:25:17.950381 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-fa68a05b-048e-4947-bb83-bfe8a7d58eee req-99601b89-b931-47cc-8bc0-940c94baaceb service nova] Creating event network-vif-plugged:e1f657e8-cda2-47ce-8831-b51d319d4c42 for instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 on hv-cinder-83736 May 17 18:25:17.951536 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0b307c90-cc9d-4d9d-815a-a1a8619948dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:17.952571 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0b307c90-cc9d-4d9d-815a-a1a8619948dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:17.962843 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-fa68a05b-048e-4947-bb83-bfe8a7d58eee req-99601b89-b931-47cc-8bc0-940c94baaceb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049424 May 17 18:25:17.964021 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 441/827] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:25:18.019297 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0b307c90-cc9d-4d9d-815a-a1a8619948dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:18.028261 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0b307c90-cc9d-4d9d-815a-a1a8619948dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:18.030167 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0b307c90-cc9d-4d9d-815a-a1a8619948dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:18.031229 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0b307c90-cc9d-4d9d-815a-a1a8619948dc tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1281 microversion: 2.20 time: 0.084513 May 17 18:25:18.032232 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 387/828] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:17 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:25:18.589317 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6cf7bc71-11f8-4e94-8305-9db940fde4db tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:18.590052 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6cf7bc71-11f8-4e94-8305-9db940fde4db tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:18.596194 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6cf7bc71-11f8-4e94-8305-9db940fde4db tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:18.596646 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6cf7bc71-11f8-4e94-8305-9db940fde4db tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:18.597418 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6cf7bc71-11f8-4e94-8305-9db940fde4db tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:18.597884 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6cf7bc71-11f8-4e94-8305-9db940fde4db tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:18.721891 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6cf7bc71-11f8-4e94-8305-9db940fde4db tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:18.729202 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6cf7bc71-11f8-4e94-8305-9db940fde4db tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1688 microversion: 2.1 time: 0.144588 May 17 18:25:18.729799 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 442/829] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:18 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1688 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:18.805005 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2043023a-3a55-4649-8cae-f0dcf78c1cbd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:18.806295 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2043023a-3a55-4649-8cae-f0dcf78c1cbd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:18.812938 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2043023a-3a55-4649-8cae-f0dcf78c1cbd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:18.813409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2043023a-3a55-4649-8cae-f0dcf78c1cbd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:18.814254 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2043023a-3a55-4649-8cae-f0dcf78c1cbd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:18.814703 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2043023a-3a55-4649-8cae-f0dcf78c1cbd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:18.952877 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2043023a-3a55-4649-8cae-f0dcf78c1cbd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:18.962535 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2043023a-3a55-4649-8cae-f0dcf78c1cbd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1365 microversion: 2.1 time: 0.162219 May 17 18:25:18.963116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 388/830] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:18 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:19.051408 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5b9e7bf2-31e8-41bc-abc6-19d2f919276a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:19.052251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5b9e7bf2-31e8-41bc-abc6-19d2f919276a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:19.058215 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5b9e7bf2-31e8-41bc-abc6-19d2f919276a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.058723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5b9e7bf2-31e8-41bc-abc6-19d2f919276a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.059506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5b9e7bf2-31e8-41bc-abc6-19d2f919276a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.059950 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5b9e7bf2-31e8-41bc-abc6-19d2f919276a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.083830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-10455993-21b9-4598-a848-e7b80b0f1a96 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:19.084957 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-10455993-21b9-4598-a848-e7b80b0f1a96 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:19.092446 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10455993-21b9-4598-a848-e7b80b0f1a96 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.093036 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10455993-21b9-4598-a848-e7b80b0f1a96 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.093969 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10455993-21b9-4598-a848-e7b80b0f1a96 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.094515 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10455993-21b9-4598-a848-e7b80b0f1a96 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.124377 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5b9e7bf2-31e8-41bc-abc6-19d2f919276a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:19.126790 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-10455993-21b9-4598-a848-e7b80b0f1a96 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046911 May 17 18:25:19.127534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 389/831] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:25:19 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:25:19.135122 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5b9e7bf2-31e8-41bc-abc6-19d2f919276a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:19.137296 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5b9e7bf2-31e8-41bc-abc6-19d2f919276a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:19.138813 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5b9e7bf2-31e8-41bc-abc6-19d2f919276a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1333 microversion: 2.20 time: 0.090992 May 17 18:25:19.139537 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 443/832] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:19 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:19.186864 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-83370334-1b07-43dd-9a93-614d6a100d09 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:19.187452 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-83370334-1b07-43dd-9a93-614d6a100d09 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:19.193554 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83370334-1b07-43dd-9a93-614d6a100d09 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.194095 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83370334-1b07-43dd-9a93-614d6a100d09 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.194927 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83370334-1b07-43dd-9a93-614d6a100d09 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.195436 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-83370334-1b07-43dd-9a93-614d6a100d09 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.224387 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-83370334-1b07-43dd-9a93-614d6a100d09 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:25:19.297967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-83370334-1b07-43dd-9a93-614d6a100d09 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 204 len: 0 microversion: 2.1 time: 0.114707 May 17 18:25:19.298590 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 390/833] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:25:19 2022] DELETE /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:25:19.307210 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-04f57544-6991-47ba-8c4c-9236c74253bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:19.308031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-04f57544-6991-47ba-8c4c-9236c74253bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:19.314905 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04f57544-6991-47ba-8c4c-9236c74253bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.315361 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04f57544-6991-47ba-8c4c-9236c74253bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.316137 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04f57544-6991-47ba-8c4c-9236c74253bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.316576 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-04f57544-6991-47ba-8c4c-9236c74253bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.447509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-04f57544-6991-47ba-8c4c-9236c74253bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:19.456123 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-04f57544-6991-47ba-8c4c-9236c74253bd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1673 microversion: 2.1 time: 0.152994 May 17 18:25:19.456723 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 444/834] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:19 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:19.601672 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-48a290ab-3afa-4009-8e53-4d354c89d091 req-6a5d011a-040c-47c3-9d6e-972563b991cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94d1524-97f8-49d7-8685-184066d438d2", "name": "network-vif-deleted", "tag": "08d646aa-87c5-4998-abe8-ddbc4d06f4f0"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:19.609517 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-48a290ab-3afa-4009-8e53-4d354c89d091 req-6a5d011a-040c-47c3-9d6e-972563b991cd service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.609922 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-48a290ab-3afa-4009-8e53-4d354c89d091 req-6a5d011a-040c-47c3-9d6e-972563b991cd service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.620758 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-48a290ab-3afa-4009-8e53-4d354c89d091 req-6a5d011a-040c-47c3-9d6e-972563b991cd service nova] Creating event network-vif-deleted:08d646aa-87c5-4998-abe8-ddbc4d06f4f0 for instance b94d1524-97f8-49d7-8685-184066d438d2 on hv-cinder-83736 May 17 18:25:19.626183 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-48a290ab-3afa-4009-8e53-4d354c89d091 req-6a5d011a-040c-47c3-9d6e-972563b991cd service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028498 May 17 18:25:19.626774 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 391/835] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:19.746915 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7355b9bb-f886-41e5-a817-2a534b919a1e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:19.747535 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7355b9bb-f886-41e5-a817-2a534b919a1e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:19.772051 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7355b9bb-f886-41e5-a817-2a534b919a1e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.782891 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7355b9bb-f886-41e5-a817-2a534b919a1e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.784050 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7355b9bb-f886-41e5-a817-2a534b919a1e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.784709 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7355b9bb-f886-41e5-a817-2a534b919a1e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.871997 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7355b9bb-f886-41e5-a817-2a534b919a1e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:19.879698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7355b9bb-f886-41e5-a817-2a534b919a1e tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1621 microversion: 2.1 time: 0.136583 May 17 18:25:19.881358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 445/836] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:19 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1621 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:19.982813 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-59fdc14a-d78b-49ee-8ba8-e26d50ecd94d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:19.983629 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-59fdc14a-d78b-49ee-8ba8-e26d50ecd94d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:19.989863 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-59fdc14a-d78b-49ee-8ba8-e26d50ecd94d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.990379 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-59fdc14a-d78b-49ee-8ba8-e26d50ecd94d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:19.991384 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-59fdc14a-d78b-49ee-8ba8-e26d50ecd94d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:19.992348 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-59fdc14a-d78b-49ee-8ba8-e26d50ecd94d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:20.133859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-59fdc14a-d78b-49ee-8ba8-e26d50ecd94d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:20.142510 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-59fdc14a-d78b-49ee-8ba8-e26d50ecd94d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1555 microversion: 2.1 time: 0.164244 May 17 18:25:20.143095 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 392/837] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:19 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:20.158795 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-311c0b42-859e-422c-8ab2-2248385957ac tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:20.159161 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a1878659-f4f9-45d5-b1ba-2b14751a8eb9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:20.159276 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-311c0b42-859e-422c-8ab2-2248385957ac tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:20.159721 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a1878659-f4f9-45d5-b1ba-2b14751a8eb9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:20.165672 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-311c0b42-859e-422c-8ab2-2248385957ac tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:20.166129 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-311c0b42-859e-422c-8ab2-2248385957ac tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:20.166442 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a1878659-f4f9-45d5-b1ba-2b14751a8eb9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:20.166894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a1878659-f4f9-45d5-b1ba-2b14751a8eb9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:20.167008 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-311c0b42-859e-422c-8ab2-2248385957ac tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:20.167345 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-311c0b42-859e-422c-8ab2-2248385957ac tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:20.167668 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a1878659-f4f9-45d5-b1ba-2b14751a8eb9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:20.168165 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a1878659-f4f9-45d5-b1ba-2b14751a8eb9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:20.264610 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a1878659-f4f9-45d5-b1ba-2b14751a8eb9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:20.272789 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a1878659-f4f9-45d5-b1ba-2b14751a8eb9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:20.274498 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a1878659-f4f9-45d5-b1ba-2b14751a8eb9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:20.275778 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a1878659-f4f9-45d5-b1ba-2b14751a8eb9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1333 microversion: 2.20 time: 0.123439 May 17 18:25:20.276838 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-311c0b42-859e-422c-8ab2-2248385957ac tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.121879 May 17 18:25:20.277085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 446/838] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:20 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1333 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:20.278797 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 393/839] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 17 18:25:20 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:25:20.473327 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4a7ffa91-9678-498f-8b7f-83cde4f26320 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:20.474139 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4a7ffa91-9678-498f-8b7f-83cde4f26320 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:20.481154 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a7ffa91-9678-498f-8b7f-83cde4f26320 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:20.481646 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a7ffa91-9678-498f-8b7f-83cde4f26320 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:20.482438 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a7ffa91-9678-498f-8b7f-83cde4f26320 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:20.482880 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a7ffa91-9678-498f-8b7f-83cde4f26320 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:20.736371 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4a7ffa91-9678-498f-8b7f-83cde4f26320 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:20.746371 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4a7ffa91-9678-498f-8b7f-83cde4f26320 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1673 microversion: 2.1 time: 0.276809 May 17 18:25:20.747043 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 447/840] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:20 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1673 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:20.897214 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-66438d7f-00de-4b8a-965c-68af9b4a4b39 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:20.898007 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-66438d7f-00de-4b8a-965c-68af9b4a4b39 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:20.904605 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-66438d7f-00de-4b8a-965c-68af9b4a4b39 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:20.905231 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-66438d7f-00de-4b8a-965c-68af9b4a4b39 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:20.906107 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-66438d7f-00de-4b8a-965c-68af9b4a4b39 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:20.906550 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-66438d7f-00de-4b8a-965c-68af9b4a4b39 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:20.997109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-66438d7f-00de-4b8a-965c-68af9b4a4b39 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:21.004357 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-66438d7f-00de-4b8a-965c-68af9b4a4b39 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 200 len: 1331 microversion: 2.1 time: 0.110946 May 17 18:25:21.004923 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 394/841] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:20 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 1331 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:21.294455 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-f725fafa-21b0-4c64-95a9-27f1abcfee36 req-b0f43542-c3a2-463c-bc1f-a3050592d02a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5daec8-cf69-4eba-b4e1-6ded1a8cec02", "tag": "e1f657e8-cda2-47ce-8831-b51d319d4c42"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:21.296386 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-dbb27a95-5726-4f01-8605-763cc220170a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:21.297211 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-dbb27a95-5726-4f01-8605-763cc220170a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:21.303872 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f725fafa-21b0-4c64-95a9-27f1abcfee36 req-b0f43542-c3a2-463c-bc1f-a3050592d02a service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:21.304321 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f725fafa-21b0-4c64-95a9-27f1abcfee36 req-b0f43542-c3a2-463c-bc1f-a3050592d02a service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:21.306984 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dbb27a95-5726-4f01-8605-763cc220170a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:21.309283 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dbb27a95-5726-4f01-8605-763cc220170a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:21.310709 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dbb27a95-5726-4f01-8605-763cc220170a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:21.311493 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dbb27a95-5726-4f01-8605-763cc220170a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:21.319641 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-f725fafa-21b0-4c64-95a9-27f1abcfee36 req-b0f43542-c3a2-463c-bc1f-a3050592d02a service nova] Creating event network-changed:e1f657e8-cda2-47ce-8831-b51d319d4c42 for instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 on hv-cinder-83736 May 17 18:25:21.327942 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-f725fafa-21b0-4c64-95a9-27f1abcfee36 req-b0f43542-c3a2-463c-bc1f-a3050592d02a service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037382 May 17 18:25:21.328553 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 395/842] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:21.387193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-dbb27a95-5726-4f01-8605-763cc220170a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:21.395105 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-dbb27a95-5726-4f01-8605-763cc220170a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:21.396615 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-dbb27a95-5726-4f01-8605-763cc220170a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:21.397750 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-dbb27a95-5726-4f01-8605-763cc220170a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1341 microversion: 2.20 time: 0.107450 May 17 18:25:21.398503 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 448/843] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:21 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1341 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:21.766453 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-10a4715e-57b7-4bce-9990-98587b2a1502 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:21.767364 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-10a4715e-57b7-4bce-9990-98587b2a1502 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:21.776043 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10a4715e-57b7-4bce-9990-98587b2a1502 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:21.777098 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10a4715e-57b7-4bce-9990-98587b2a1502 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:21.778757 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10a4715e-57b7-4bce-9990-98587b2a1502 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:21.779443 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-10a4715e-57b7-4bce-9990-98587b2a1502 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:22.020957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0d7748aa-c558-4700-92f9-3b5569080258 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:22.021719 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0d7748aa-c558-4700-92f9-3b5569080258 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: b94d1524-97f8-49d7-8685-184066d438d2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:22.033974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0d7748aa-c558-4700-92f9-3b5569080258 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:22.034650 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0d7748aa-c558-4700-92f9-3b5569080258 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:22.037386 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0d7748aa-c558-4700-92f9-3b5569080258 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:22.038853 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0d7748aa-c558-4700-92f9-3b5569080258 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:22.069362 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-0d7748aa-c558-4700-92f9-3b5569080258 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] HTTP exception thrown: Instance b94d1524-97f8-49d7-8685-184066d438d2 could not be found. May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0d7748aa-c558-4700-92f9-3b5569080258 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Request method failure captured: May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 HTTP/1.1 May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bPT5PJb4v2TtchlazaTc4tsgElmPs7hEcTqQ-3XK5tZM_VLzGHdXJdr2rSJCb1gYx1SrW3nB-whM3bgmSozRTJNa1tqgL318uDZXw6jKtkeLg2QsgmksivrEql1pdoXv8CkKOVUB4re9ufg_nU903_wvc0E5GAJ53_vzIvqUBewKo May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: b7d713a65f9e4071988e5df2fbf90b17 May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:25:22.072241 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: b7d713a65f9e4071988e5df2fbf90b17 May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-ServerRescueNegativeTestJSON-510098100-project May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 5e6f035cadd24a59803eec21c7b9e2c5 May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-ServerRescueNegativeTestJSON-510098100-project May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance b94d1524-97f8-49d7-8685-184066d438d2 could not be found. May 17 18:25:22.073971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': 'b94d1524-97f8-49d7-8685-184066d438d2'} May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94d1524-97f8-49d7-8685-184066d438d2 could not be found. May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:25:22.075660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94d1524-97f8-49d7-8685-184066d438d2 could not be found. May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94d1524-97f8-49d7-8685-184066d438d2 could not be found. May 17 18:25:22.078024 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:22.080606 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0d7748aa-c558-4700-92f9-3b5569080258 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Returning 404 to user: Instance b94d1524-97f8-49d7-8685-184066d438d2 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:25:22.081855 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0d7748aa-c558-4700-92f9-3b5569080258 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2" status: 404 len: 111 microversion: 2.1 time: 0.065448 May 17 18:25:22.083027 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 449/844] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:22 2022] GET /compute/v2.1/servers/b94d1524-97f8-49d7-8685-184066d438d2 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:25:22.092118 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2ba9e4ef-699f-4139-9838-6bd736cab177 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '.version_select at 0x7f4e5b267e50>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:22.114013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-10a4715e-57b7-4bce-9990-98587b2a1502 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:22.123366 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-10a4715e-57b7-4bce-9990-98587b2a1502 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1673 microversion: 2.1 time: 0.362784 May 17 18:25:22.125098 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 396/845] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:21 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1673 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:22.136391 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2ba9e4ef-699f-4139-9838-6bd736cab177 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032767693" status: 202 len: 0 microversion: 2.1 time: 0.049193 May 17 18:25:22.140485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 450/846] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 17 18:25:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032767693 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:25:22.428185 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4bbe5d7b-c728-44fa-af41-e843a93e512a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:22.429260 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4bbe5d7b-c728-44fa-af41-e843a93e512a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:22.440015 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bbe5d7b-c728-44fa-af41-e843a93e512a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:22.443091 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bbe5d7b-c728-44fa-af41-e843a93e512a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:22.444233 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bbe5d7b-c728-44fa-af41-e843a93e512a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:22.445500 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bbe5d7b-c728-44fa-af41-e843a93e512a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:22.586190 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4bbe5d7b-c728-44fa-af41-e843a93e512a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:22.613241 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4bbe5d7b-c728-44fa-af41-e843a93e512a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:22.620643 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4bbe5d7b-c728-44fa-af41-e843a93e512a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:22.624792 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4bbe5d7b-c728-44fa-af41-e843a93e512a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1339 microversion: 2.20 time: 0.210755 May 17 18:25:22.626338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 397/847] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:22 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1339 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:23.142827 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-22778d17-332e-453d-a572-06a50c3299ad tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:23.144100 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-22778d17-332e-453d-a572-06a50c3299ad tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:23.151281 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22778d17-332e-453d-a572-06a50c3299ad tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:23.151736 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22778d17-332e-453d-a572-06a50c3299ad tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:23.152554 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22778d17-332e-453d-a572-06a50c3299ad tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:23.153167 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22778d17-332e-453d-a572-06a50c3299ad tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:23.280965 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-22778d17-332e-453d-a572-06a50c3299ad tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:23.293114 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-22778d17-332e-453d-a572-06a50c3299ad tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 200 len: 1605 microversion: 2.1 time: 0.152480 May 17 18:25:23.296549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 451/848] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:23 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 1605 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:25:23.316910 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-d67206a1-115b-4f1f-81db-723207c05bba req-c7e7b138-f720-4895-bdaa-320af72856b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b730dca-866b-4096-9175-6d27c3d35e55", "name": "network-vif-deleted", "tag": "d33b9990-24b2-40c1-bba4-2f0d0da36778"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:23.344786 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-d67206a1-115b-4f1f-81db-723207c05bba req-c7e7b138-f720-4895-bdaa-320af72856b0 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:23.346322 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-d67206a1-115b-4f1f-81db-723207c05bba req-c7e7b138-f720-4895-bdaa-320af72856b0 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:23.387416 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-d67206a1-115b-4f1f-81db-723207c05bba req-c7e7b138-f720-4895-bdaa-320af72856b0 service nova] Creating event network-vif-deleted:d33b9990-24b2-40c1-bba4-2f0d0da36778 for instance 8b730dca-866b-4096-9175-6d27c3d35e55 on hv-cinder-83736 May 17 18:25:23.400424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-d67206a1-115b-4f1f-81db-723207c05bba req-c7e7b138-f720-4895-bdaa-320af72856b0 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090082 May 17 18:25:23.404540 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 398/849] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:23.647083 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-40b8a5a0-c657-4c17-822b-7d38c2d64ae3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:23.647646 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-40b8a5a0-c657-4c17-822b-7d38c2d64ae3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:23.654276 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40b8a5a0-c657-4c17-822b-7d38c2d64ae3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:23.654990 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40b8a5a0-c657-4c17-822b-7d38c2d64ae3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:23.655767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40b8a5a0-c657-4c17-822b-7d38c2d64ae3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:23.656205 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40b8a5a0-c657-4c17-822b-7d38c2d64ae3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:23.820747 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-40b8a5a0-c657-4c17-822b-7d38c2d64ae3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:23.833534 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-40b8a5a0-c657-4c17-822b-7d38c2d64ae3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:23.836249 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-40b8a5a0-c657-4c17-822b-7d38c2d64ae3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:23.838164 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-40b8a5a0-c657-4c17-822b-7d38c2d64ae3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1406 microversion: 2.20 time: 0.194865 May 17 18:25:23.839209 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 452/850] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:23 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:24.314085 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3264d967-aa36-44c3-8752-15d70dee57d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:24.316811 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-3264d967-aa36-44c3-8752-15d70dee57d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:24.325660 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3264d967-aa36-44c3-8752-15d70dee57d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:24.326307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3264d967-aa36-44c3-8752-15d70dee57d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:24.327089 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3264d967-aa36-44c3-8752-15d70dee57d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:24.327902 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3264d967-aa36-44c3-8752-15d70dee57d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:24.349236 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-3264d967-aa36-44c3-8752-15d70dee57d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] HTTP exception thrown: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3264d967-aa36-44c3-8752-15d70dee57d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Request method failure captured: May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 HTTP/1.1 May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bInLecLATqR-ppc61l2WGEmEFb7NTAYYrQTGRIfd8bjqN3Qy_FONRMaIknlVJIgB2f13JLnQ0JfbTfu-hzVBeYpHglYCxPqGKyYK375qcXOlIKVGpT5ekFfN9v6zG2m9d_q-SnIBku5kejH2HgYdwz5RJnRn9jBN-RvWObieF3KL0 May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:25:24.351169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-AttachVolumeTestJSON-1240414743 May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 356af648841c44eeab0bd9c7f78f600a May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:25:24.352724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '8b730dca-866b-4096-9175-6d27c3d35e55'} May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:25:24.357342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:25:24.358832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:25:24.360101 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3264d967-aa36-44c3-8752-15d70dee57d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Returning 404 to user: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:25:24.360101 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-3264d967-aa36-44c3-8752-15d70dee57d6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 404 len: 111 microversion: 2.1 time: 0.044087 May 17 18:25:24.360101 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 399/851] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:24 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:25:24.364200 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3c32b6bf-71bd-46a2-a87d-fcda004830e3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '.version_select at 0x7f4e5b286a60>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:24.390345 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3c32b6bf-71bd-46a2-a87d-fcda004830e3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637869322" status: 202 len: 0 microversion: 2.1 time: 0.031066 May 17 18:25:24.391396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 453/852] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 17 18:25:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637869322 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:25:24.856989 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2b0f0bf2-e2f4-4906-a496-48814d2eac02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:24.857626 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2b0f0bf2-e2f4-4906-a496-48814d2eac02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:24.866607 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2b0f0bf2-e2f4-4906-a496-48814d2eac02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:24.867056 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2b0f0bf2-e2f4-4906-a496-48814d2eac02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:24.867827 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2b0f0bf2-e2f4-4906-a496-48814d2eac02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:24.868262 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2b0f0bf2-e2f4-4906-a496-48814d2eac02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:25.094284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2b0f0bf2-e2f4-4906-a496-48814d2eac02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:25.103082 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2b0f0bf2-e2f4-4906-a496-48814d2eac02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:25.104598 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2b0f0bf2-e2f4-4906-a496-48814d2eac02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:25.105730 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2b0f0bf2-e2f4-4906-a496-48814d2eac02 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1406 microversion: 2.20 time: 0.253514 May 17 18:25:25.106282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 400/853] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:24 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1406 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:25.131583 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3f2d5f2d-d211-4fc0-bf3f-021446be095c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Action: 'create', calling method: .version_select at 0x7f4e5b26dee0>, body: {"keypair": {"name": "tempest-keypair-1060328470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQmvBOIW2U6kihCpcaJ5SK/5Zz97yPuQ3BnvnKPy5DPa1slvuSz1mS6n0kzSl65ksAhs3N0fvBFfF9winK+c/HHtFH2vRaOOMSB1qUGnV5WQ5R9AEfvzc30DcfOHNPrFw=="}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:25.146158 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-3f2d5f2d-d211-4fc0-bf3f-021446be095c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Getting quotas for project cd7eb45f1cd74f84943f4b991986973d. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:25:25.149902 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-3f2d5f2d-d211-4fc0-bf3f-021446be095c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Getting quotas for user 356af648841c44eeab0bd9c7f78f600a and project cd7eb45f1cd74f84943f4b991986973d. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:25:25.171946 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3f2d5f2d-d211-4fc0-bf3f-021446be095c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044210 May 17 18:25:25.172645 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 454/854] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 17 18:25:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:25.423129 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-e2b52301-21c9-4fc7-9aa2-eb6ba922732a req-ff18167c-fbaa-4335-833a-28177dd2b282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d4de87-f1c0-4e32-9c17-09a87a23dc55", "tag": "9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:25.431417 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-e2b52301-21c9-4fc7-9aa2-eb6ba922732a req-ff18167c-fbaa-4335-833a-28177dd2b282 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:25.431861 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-e2b52301-21c9-4fc7-9aa2-eb6ba922732a req-ff18167c-fbaa-4335-833a-28177dd2b282 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:25.442653 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-e2b52301-21c9-4fc7-9aa2-eb6ba922732a req-ff18167c-fbaa-4335-833a-28177dd2b282 service nova] Creating event network-changed:9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f for instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 on hv-cinder-83736 May 17 18:25:25.448007 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-e2b52301-21c9-4fc7-9aa2-eb6ba922732a req-ff18167c-fbaa-4335-833a-28177dd2b282 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031912 May 17 18:25:25.448461 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 401/855] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:25.777068 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-86e87061-224c-40bc-9433-a8a4a5ac1c09 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:25.777647 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-86e87061-224c-40bc-9433-a8a4a5ac1c09 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:25.783843 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-86e87061-224c-40bc-9433-a8a4a5ac1c09 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:25.784308 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-86e87061-224c-40bc-9433-a8a4a5ac1c09 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:25.785090 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-86e87061-224c-40bc-9433-a8a4a5ac1c09 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:25.785786 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-86e87061-224c-40bc-9433-a8a4a5ac1c09 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:25.812895 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-86e87061-224c-40bc-9433-a8a4a5ac1c09 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Going to try to terminate instance {{(pid=117098) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:25:25.887608 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-86e87061-224c-40bc-9433-a8a4a5ac1c09 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "DELETE /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 204 len: 0 microversion: 2.1 time: 0.114158 May 17 18:25:25.888202 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 455/856] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:25:25 2022] DELETE /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 18:25:25.897179 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4c61f96a-9c10-4709-8c8b-cde9cfcde5fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:25.897914 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4c61f96a-9c10-4709-8c8b-cde9cfcde5fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:25.904065 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4c61f96a-9c10-4709-8c8b-cde9cfcde5fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:25.904598 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4c61f96a-9c10-4709-8c8b-cde9cfcde5fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:25.905486 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4c61f96a-9c10-4709-8c8b-cde9cfcde5fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:25.905998 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4c61f96a-9c10-4709-8c8b-cde9cfcde5fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:26.043639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4c61f96a-9c10-4709-8c8b-cde9cfcde5fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:26.051095 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4c61f96a-9c10-4709-8c8b-cde9cfcde5fb tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1505 microversion: 2.1 time: 0.158142 May 17 18:25:26.051670 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 402/857] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:25 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:26.123415 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-52df8fe6-76ca-4426-9233-d0f522cf224d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:26.124233 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-52df8fe6-76ca-4426-9233-d0f522cf224d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:26.130093 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52df8fe6-76ca-4426-9233-d0f522cf224d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:26.130611 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52df8fe6-76ca-4426-9233-d0f522cf224d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:26.131444 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52df8fe6-76ca-4426-9233-d0f522cf224d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:26.131945 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52df8fe6-76ca-4426-9233-d0f522cf224d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:26.270786 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-52df8fe6-76ca-4426-9233-d0f522cf224d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:26.279125 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-52df8fe6-76ca-4426-9233-d0f522cf224d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:26.280622 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-52df8fe6-76ca-4426-9233-d0f522cf224d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:26.281741 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-52df8fe6-76ca-4426-9233-d0f522cf224d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1406 microversion: 2.20 time: 0.162709 May 17 18:25:26.282291 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 456/858] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:26 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:26.290909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1611257210", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "68688597-c210-4792-9189-73af0d2f702a"}], "security_groups": [{"name": "tempest-securitygroup--1016579413"}], "key_name": "tempest-keypair-1060328470", "user_data": "}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:26.388649 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] validate_networks() for [('68688597-c210-4792-9189-73af0d2f702a', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:25:26.745480 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:25:26.746062 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:25:26.746298 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:25:26.746701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:25:26.747109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:25:26.755782 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:26.756230 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:26.757029 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:26.757485 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:26.773911 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Getting quotas for project cd7eb45f1cd74f84943f4b991986973d. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:25:26.778388 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Getting quotas for user 356af648841c44eeab0bd9c7f78f600a and project cd7eb45f1cd74f84943f4b991986973d. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:25:26.789000 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:25:26.791254 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:25:26.837324 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e5d8b657-fee9-44fc-bac2-759692b78107 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.550637 May 17 18:25:26.838012 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 403/859] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:25:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:25:26.848221 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d5df4a3b-7487-4789-b3cc-04063ad0ff70 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:26.849028 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d5df4a3b-7487-4789-b3cc-04063ad0ff70 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:26.908456 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d5df4a3b-7487-4789-b3cc-04063ad0ff70 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:26.917341 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d5df4a3b-7487-4789-b3cc-04063ad0ff70 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1238 microversion: 2.1 time: 0.072983 May 17 18:25:26.918011 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 457/860] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:26 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:27.068141 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-27b4a1c0-548a-45d8-8bc2-12b48850b4e0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:27.068756 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-27b4a1c0-548a-45d8-8bc2-12b48850b4e0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:27.076116 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-27b4a1c0-548a-45d8-8bc2-12b48850b4e0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:27.076572 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-27b4a1c0-548a-45d8-8bc2-12b48850b4e0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:27.077344 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-27b4a1c0-548a-45d8-8bc2-12b48850b4e0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:27.077812 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-27b4a1c0-548a-45d8-8bc2-12b48850b4e0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:27.214528 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-27b4a1c0-548a-45d8-8bc2-12b48850b4e0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:27.222138 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-27b4a1c0-548a-45d8-8bc2-12b48850b4e0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1505 microversion: 2.1 time: 0.157917 May 17 18:25:27.225491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 404/861] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:27 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:27.300049 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9226a101-8489-4a6d-99a0-bd2cb1d26503 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:27.300618 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9226a101-8489-4a6d-99a0-bd2cb1d26503 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:27.306537 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9226a101-8489-4a6d-99a0-bd2cb1d26503 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:27.307186 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9226a101-8489-4a6d-99a0-bd2cb1d26503 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:27.308164 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9226a101-8489-4a6d-99a0-bd2cb1d26503 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:27.308771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9226a101-8489-4a6d-99a0-bd2cb1d26503 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:27.440485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9226a101-8489-4a6d-99a0-bd2cb1d26503 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:27.448461 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9226a101-8489-4a6d-99a0-bd2cb1d26503 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:27.450879 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9226a101-8489-4a6d-99a0-bd2cb1d26503 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:27.451983 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9226a101-8489-4a6d-99a0-bd2cb1d26503 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1406 microversion: 2.20 time: 0.156282 May 17 18:25:27.452533 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 458/862] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:27 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:27.934404 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e6f10a31-de65-4758-bac0-dd9ebd928b4b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:27.935426 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e6f10a31-de65-4758-bac0-dd9ebd928b4b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:27.941716 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e6f10a31-de65-4758-bac0-dd9ebd928b4b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:27.942423 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e6f10a31-de65-4758-bac0-dd9ebd928b4b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:27.943375 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e6f10a31-de65-4758-bac0-dd9ebd928b4b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:27.943974 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e6f10a31-de65-4758-bac0-dd9ebd928b4b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:28.009286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e6f10a31-de65-4758-bac0-dd9ebd928b4b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:28.021476 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e6f10a31-de65-4758-bac0-dd9ebd928b4b tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1290 microversion: 2.1 time: 0.090340 May 17 18:25:28.022746 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 405/863] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:27 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:28.239658 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-16454d91-806b-4f10-b48f-02d5be540790 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:28.240273 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-16454d91-806b-4f10-b48f-02d5be540790 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:28.247324 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-16454d91-806b-4f10-b48f-02d5be540790 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:28.247714 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-16454d91-806b-4f10-b48f-02d5be540790 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:28.248933 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-16454d91-806b-4f10-b48f-02d5be540790 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:28.249119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-16454d91-806b-4f10-b48f-02d5be540790 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:28.378236 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-16454d91-806b-4f10-b48f-02d5be540790 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:28.385645 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-16454d91-806b-4f10-b48f-02d5be540790 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 200 len: 1505 microversion: 2.1 time: 0.149828 May 17 18:25:28.386226 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 459/864] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:28 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:28.470738 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e850496c-7fa6-43af-8c83-489686007d4a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:28.471777 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e850496c-7fa6-43af-8c83-489686007d4a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:28.478798 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e850496c-7fa6-43af-8c83-489686007d4a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:28.479341 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e850496c-7fa6-43af-8c83-489686007d4a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:28.481310 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e850496c-7fa6-43af-8c83-489686007d4a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:28.481747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e850496c-7fa6-43af-8c83-489686007d4a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:28.630976 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-0b6e4f2f-6ea1-4709-9038-c8345566a2b4 req-8d54cd7c-4c42-42d8-8e4a-528a24762d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56e0dba9-a1b6-44ad-af16-8419624a2ba6", "name": "network-vif-deleted", "tag": "43a789b0-1ac7-4729-8cc9-8ad941391439"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:28.640387 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-0b6e4f2f-6ea1-4709-9038-c8345566a2b4 req-8d54cd7c-4c42-42d8-8e4a-528a24762d64 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:28.641169 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-0b6e4f2f-6ea1-4709-9038-c8345566a2b4 req-8d54cd7c-4c42-42d8-8e4a-528a24762d64 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:28.641803 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e850496c-7fa6-43af-8c83-489686007d4a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:28.654002 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-0b6e4f2f-6ea1-4709-9038-c8345566a2b4 req-8d54cd7c-4c42-42d8-8e4a-528a24762d64 service nova] Creating event network-vif-deleted:43a789b0-1ac7-4729-8cc9-8ad941391439 for instance 56e0dba9-a1b6-44ad-af16-8419624a2ba6 on hv-cinder-83736 May 17 18:25:28.654787 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e850496c-7fa6-43af-8c83-489686007d4a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:28.656315 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e850496c-7fa6-43af-8c83-489686007d4a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:28.658704 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e850496c-7fa6-43af-8c83-489686007d4a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1406 microversion: 2.20 time: 0.192448 May 17 18:25:28.659536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-0b6e4f2f-6ea1-4709-9038-c8345566a2b4 req-8d54cd7c-4c42-42d8-8e4a-528a24762d64 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036730 May 17 18:25:28.659812 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 406/865] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:28 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:28.660934 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 460/866] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:29.042196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-dae248d2-e9da-4aaa-9d91-8f305caa93a0 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:29.042842 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-dae248d2-e9da-4aaa-9d91-8f305caa93a0 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:29.049115 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dae248d2-e9da-4aaa-9d91-8f305caa93a0 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:29.049591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dae248d2-e9da-4aaa-9d91-8f305caa93a0 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:29.050364 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dae248d2-e9da-4aaa-9d91-8f305caa93a0 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:29.050801 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dae248d2-e9da-4aaa-9d91-8f305caa93a0 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:29.198364 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dae248d2-e9da-4aaa-9d91-8f305caa93a0 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:29.208061 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-dae248d2-e9da-4aaa-9d91-8f305caa93a0 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1364 microversion: 2.1 time: 0.169532 May 17 18:25:29.209355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 407/867] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:29 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:29.403555 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b4d1c9e5-1259-4389-bc35-044356773695 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:29.404261 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b4d1c9e5-1259-4389-bc35-044356773695 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 56e0dba9-a1b6-44ad-af16-8419624a2ba6] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:29.410387 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b4d1c9e5-1259-4389-bc35-044356773695 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:29.410844 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b4d1c9e5-1259-4389-bc35-044356773695 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:29.411613 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b4d1c9e5-1259-4389-bc35-044356773695 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:29.412084 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b4d1c9e5-1259-4389-bc35-044356773695 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:29.428399 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-b4d1c9e5-1259-4389-bc35-044356773695 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] HTTP exception thrown: Instance 56e0dba9-a1b6-44ad-af16-8419624a2ba6 could not be found. May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b4d1c9e5-1259-4389-bc35-044356773695 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Request method failure captured: May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 HTTP/1.1 May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bPT5PJb4v2TtchlazaTc4tsgElmPs7hEcTqQ-3XK5tZM_VLzGHdXJdr2rSJCb1gYx1SrW3nB-whM3bgmSozRTJNa1tqgL318uDZXw6jKtkeLg2QsgmksivrEql1pdoXv8CkKOVUB4re9ufg_nU903_wvc0E5GAJ53_vzIvqUBewKo May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: b7d713a65f9e4071988e5df2fbf90b17 May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:25:29.430107 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: b7d713a65f9e4071988e5df2fbf90b17 May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-ServerRescueNegativeTestJSON-510098100-project May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 5e6f035cadd24a59803eec21c7b9e2c5 May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-ServerRescueNegativeTestJSON-510098100-project May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 56e0dba9-a1b6-44ad-af16-8419624a2ba6 could not be found. May 17 18:25:29.431628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '56e0dba9-a1b6-44ad-af16-8419624a2ba6'} May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56e0dba9-a1b6-44ad-af16-8419624a2ba6 could not be found. May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:25:29.436519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56e0dba9-a1b6-44ad-af16-8419624a2ba6 could not be found. May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56e0dba9-a1b6-44ad-af16-8419624a2ba6 could not be found. May 17 18:25:29.438316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:29.440806 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b4d1c9e5-1259-4389-bc35-044356773695 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Returning 404 to user: Instance 56e0dba9-a1b6-44ad-af16-8419624a2ba6 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:25:29.440806 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b4d1c9e5-1259-4389-bc35-044356773695 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6" status: 404 len: 111 microversion: 2.1 time: 0.032695 May 17 18:25:29.440806 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 461/868] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:29 2022] GET /compute/v2.1/servers/56e0dba9-a1b6-44ad-af16-8419624a2ba6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:25:29.441057 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f9c0d2d8-3445-4d56-8714-b3ff66c6547b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:29.441057 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f9c0d2d8-3445-4d56-8714-b3ff66c6547b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:29.446898 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9c0d2d8-3445-4d56-8714-b3ff66c6547b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:29.447353 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9c0d2d8-3445-4d56-8714-b3ff66c6547b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:29.448130 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9c0d2d8-3445-4d56-8714-b3ff66c6547b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:29.448573 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9c0d2d8-3445-4d56-8714-b3ff66c6547b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:29.474419 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f9c0d2d8-3445-4d56-8714-b3ff66c6547b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:25:29.551841 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f9c0d2d8-3445-4d56-8714-b3ff66c6547b tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "DELETE /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 204 len: 0 microversion: 2.1 time: 0.114694 May 17 18:25:29.552610 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 408/869] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:25:29 2022] DELETE /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:25:29.562796 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7fe8fa87-6807-4112-83a6-e3bc6753e963 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:29.563419 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7fe8fa87-6807-4112-83a6-e3bc6753e963 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:29.569400 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7fe8fa87-6807-4112-83a6-e3bc6753e963 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:29.569892 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7fe8fa87-6807-4112-83a6-e3bc6753e963 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:29.570657 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7fe8fa87-6807-4112-83a6-e3bc6753e963 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:29.571091 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7fe8fa87-6807-4112-83a6-e3bc6753e963 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:29.678061 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-35258f72-9ce2-49be-b016-9655cecea45a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:29.679723 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-35258f72-9ce2-49be-b016-9655cecea45a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:29.690474 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-35258f72-9ce2-49be-b016-9655cecea45a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:29.691139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-35258f72-9ce2-49be-b016-9655cecea45a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:29.692106 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-35258f72-9ce2-49be-b016-9655cecea45a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:29.692709 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-35258f72-9ce2-49be-b016-9655cecea45a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:29.952430 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-35258f72-9ce2-49be-b016-9655cecea45a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:29.962843 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-35258f72-9ce2-49be-b016-9655cecea45a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:29.965352 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7fe8fa87-6807-4112-83a6-e3bc6753e963 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:29.965741 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-35258f72-9ce2-49be-b016-9655cecea45a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:29.967058 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-35258f72-9ce2-49be-b016-9655cecea45a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1406 microversion: 2.20 time: 0.294161 May 17 18:25:29.968219 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 409/870] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:29 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:29.978787 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7fe8fa87-6807-4112-83a6-e3bc6753e963 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1520 microversion: 2.1 time: 0.421250 May 17 18:25:29.979550 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 462/871] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:29 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:30.225644 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3e48c1a1-891f-426d-bc66-9b64cc2fc59c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:30.226258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-3e48c1a1-891f-426d-bc66-9b64cc2fc59c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:30.232738 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3e48c1a1-891f-426d-bc66-9b64cc2fc59c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:30.233185 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3e48c1a1-891f-426d-bc66-9b64cc2fc59c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:30.233977 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3e48c1a1-891f-426d-bc66-9b64cc2fc59c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:30.234412 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3e48c1a1-891f-426d-bc66-9b64cc2fc59c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:30.363396 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-3e48c1a1-891f-426d-bc66-9b64cc2fc59c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:30.370612 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-3e48c1a1-891f-426d-bc66-9b64cc2fc59c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1364 microversion: 2.1 time: 0.148806 May 17 18:25:30.371173 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 410/872] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:30 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:30.913787 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-4ed1ff9d-0cb1-45d9-ba3f-a966b2b1d7d1 req-cc088337-0086-4f78-8500-d4df8b0a933b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e325b5f-1d56-4055-829d-f41198c02382", "tag": "cc3e9b30-1b25-4bea-a3bb-d2e98cb94f96"}, {"server_uuid": "01e82dfe-21e6-427a-82b1-0b2362423057", "name": "network-vif-deleted", "tag": "1740059f-81f9-4984-963e-accf4e584516"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:30.925614 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-4ed1ff9d-0cb1-45d9-ba3f-a966b2b1d7d1 req-cc088337-0086-4f78-8500-d4df8b0a933b service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:30.926234 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-4ed1ff9d-0cb1-45d9-ba3f-a966b2b1d7d1 req-cc088337-0086-4f78-8500-d4df8b0a933b service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:30.939067 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-4ed1ff9d-0cb1-45d9-ba3f-a966b2b1d7d1 req-cc088337-0086-4f78-8500-d4df8b0a933b service nova] Creating event network-changed:cc3e9b30-1b25-4bea-a3bb-d2e98cb94f96 for instance 8e325b5f-1d56-4055-829d-f41198c02382 on hv-cinder-83736 May 17 18:25:30.939581 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-4ed1ff9d-0cb1-45d9-ba3f-a966b2b1d7d1 req-cc088337-0086-4f78-8500-d4df8b0a933b service nova] Creating event network-vif-deleted:1740059f-81f9-4984-963e-accf4e584516 for instance 01e82dfe-21e6-427a-82b1-0b2362423057 on hv-cinder-83736 May 17 18:25:30.946242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-4ed1ff9d-0cb1-45d9-ba3f-a966b2b1d7d1 req-cc088337-0086-4f78-8500-d4df8b0a933b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037519 May 17 18:25:30.946828 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 463/873] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:30.985798 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-25b3112f-2024-4bea-a48d-0eb2079d9512 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:30.986601 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-25b3112f-2024-4bea-a48d-0eb2079d9512 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:30.993353 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-25b3112f-2024-4bea-a48d-0eb2079d9512 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:30.993845 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-25b3112f-2024-4bea-a48d-0eb2079d9512 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:30.994645 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-25b3112f-2024-4bea-a48d-0eb2079d9512 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:30.995264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-25b3112f-2024-4bea-a48d-0eb2079d9512 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:30.996825 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8879cde4-2aa0-4c85-a2b8-cc64c72c18df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:30.997637 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-8879cde4-2aa0-4c85-a2b8-cc64c72c18df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:31.003931 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8879cde4-2aa0-4c85-a2b8-cc64c72c18df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:31.004397 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8879cde4-2aa0-4c85-a2b8-cc64c72c18df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:31.005247 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8879cde4-2aa0-4c85-a2b8-cc64c72c18df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:31.005812 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8879cde4-2aa0-4c85-a2b8-cc64c72c18df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:31.086763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8879cde4-2aa0-4c85-a2b8-cc64c72c18df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:31.094797 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8879cde4-2aa0-4c85-a2b8-cc64c72c18df tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1478 microversion: 2.1 time: 0.102519 May 17 18:25:31.095386 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 464/874] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:30 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1478 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:25:31.148986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-25b3112f-2024-4bea-a48d-0eb2079d9512 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:31.157238 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-25b3112f-2024-4bea-a48d-0eb2079d9512 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:31.158795 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-25b3112f-2024-4bea-a48d-0eb2079d9512 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:31.159899 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-25b3112f-2024-4bea-a48d-0eb2079d9512 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1406 microversion: 2.20 time: 0.178217 May 17 18:25:31.160456 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 411/875] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:30 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:31.388050 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-30716d51-0e1e-4365-ade1-3f2f6a81c4a6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:31.388662 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-30716d51-0e1e-4365-ade1-3f2f6a81c4a6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:31.394644 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-30716d51-0e1e-4365-ade1-3f2f6a81c4a6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:31.395095 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-30716d51-0e1e-4365-ade1-3f2f6a81c4a6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:31.395859 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-30716d51-0e1e-4365-ade1-3f2f6a81c4a6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:31.396301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-30716d51-0e1e-4365-ade1-3f2f6a81c4a6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:31.521911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-30716d51-0e1e-4365-ade1-3f2f6a81c4a6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:31.529144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-30716d51-0e1e-4365-ade1-3f2f6a81c4a6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1364 microversion: 2.1 time: 0.145587 May 17 18:25:31.529720 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 465/876] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:31 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:31.995234 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-46306a7f-e016-4def-a0eb-00c8d5f1e311 req-acbc84eb-4151-4c02-8821-514e204e154b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d4de87-f1c0-4e32-9c17-09a87a23dc55", "name": "network-vif-plugged", "status": "completed", "tag": "9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:32.005058 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-46306a7f-e016-4def-a0eb-00c8d5f1e311 req-acbc84eb-4151-4c02-8821-514e204e154b service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:32.005704 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-46306a7f-e016-4def-a0eb-00c8d5f1e311 req-acbc84eb-4151-4c02-8821-514e204e154b service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:32.016888 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-46306a7f-e016-4def-a0eb-00c8d5f1e311 req-acbc84eb-4151-4c02-8821-514e204e154b service nova] Creating event network-vif-plugged:9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f for instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 on hv-cinder-83736 May 17 18:25:32.021748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-46306a7f-e016-4def-a0eb-00c8d5f1e311 req-acbc84eb-4151-4c02-8821-514e204e154b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030135 May 17 18:25:32.022479 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 412/877] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:32.112235 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0c313d38-8b44-4fb6-b988-191bf851241a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:32.112798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0c313d38-8b44-4fb6-b988-191bf851241a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:32.119213 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0c313d38-8b44-4fb6-b988-191bf851241a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:32.119669 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0c313d38-8b44-4fb6-b988-191bf851241a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:32.120444 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0c313d38-8b44-4fb6-b988-191bf851241a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:32.120890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0c313d38-8b44-4fb6-b988-191bf851241a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:32.177273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0373d18e-802d-4561-a534-40597ca8eba4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:32.177997 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0373d18e-802d-4561-a534-40597ca8eba4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:32.181403 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0c313d38-8b44-4fb6-b988-191bf851241a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:32.184196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0373d18e-802d-4561-a534-40597ca8eba4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:32.184654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0373d18e-802d-4561-a534-40597ca8eba4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:32.185424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0373d18e-802d-4561-a534-40597ca8eba4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:32.185883 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0373d18e-802d-4561-a534-40597ca8eba4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:32.188977 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0c313d38-8b44-4fb6-b988-191bf851241a tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1478 microversion: 2.1 time: 0.080665 May 17 18:25:32.189565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 466/878] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:32 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1478 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:32.319179 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0373d18e-802d-4561-a534-40597ca8eba4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:32.327105 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0373d18e-802d-4561-a534-40597ca8eba4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:32.328669 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0373d18e-802d-4561-a534-40597ca8eba4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:32.329792 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0373d18e-802d-4561-a534-40597ca8eba4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1406 microversion: 2.20 time: 0.156732 May 17 18:25:32.330347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 413/879] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:32 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:25:32.545783 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d7689faf-6174-4c37-a777-e3272de41214 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:32.546390 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d7689faf-6174-4c37-a777-e3272de41214 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:32.552219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d7689faf-6174-4c37-a777-e3272de41214 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:32.552668 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d7689faf-6174-4c37-a777-e3272de41214 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:32.553428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d7689faf-6174-4c37-a777-e3272de41214 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:32.553890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d7689faf-6174-4c37-a777-e3272de41214 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:32.676976 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d7689faf-6174-4c37-a777-e3272de41214 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:32.684101 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d7689faf-6174-4c37-a777-e3272de41214 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1364 microversion: 2.1 time: 0.142230 May 17 18:25:32.684649 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 467/880] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:32 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:33.206167 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-02f01470-36ec-4e69-a7b5-17a5b4d811d0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:33.206780 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-02f01470-36ec-4e69-a7b5-17a5b4d811d0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:33.213236 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-02f01470-36ec-4e69-a7b5-17a5b4d811d0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:33.213725 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-02f01470-36ec-4e69-a7b5-17a5b4d811d0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:33.214552 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-02f01470-36ec-4e69-a7b5-17a5b4d811d0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:33.214993 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-02f01470-36ec-4e69-a7b5-17a5b4d811d0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:33.245314 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-02f01470-36ec-4e69-a7b5-17a5b4d811d0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:33.248306 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-02f01470-36ec-4e69-a7b5-17a5b4d811d0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:33.248891 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-02f01470-36ec-4e69-a7b5-17a5b4d811d0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lazy-loading 'fault' on Instance uuid 01e82dfe-21e6-427a-82b1-0b2362423057 {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:25:33.288545 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-02f01470-36ec-4e69-a7b5-17a5b4d811d0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e6f035cadd24a59803eec21c7b9e2c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d713a65f9e4071988e5df2fbf90b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:33.296218 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-02f01470-36ec-4e69-a7b5-17a5b4d811d0 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 200 len: 1311 microversion: 2.1 time: 0.094038 May 17 18:25:33.296781 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 414/881] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:33 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:33.347579 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1644e12a-5d79-45e0-9b68-6d371f2ab490 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:33.348265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1644e12a-5d79-45e0-9b68-6d371f2ab490 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:33.360587 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1644e12a-5d79-45e0-9b68-6d371f2ab490 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:33.361043 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1644e12a-5d79-45e0-9b68-6d371f2ab490 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:33.361869 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1644e12a-5d79-45e0-9b68-6d371f2ab490 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:33.362311 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1644e12a-5d79-45e0-9b68-6d371f2ab490 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:33.543940 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1644e12a-5d79-45e0-9b68-6d371f2ab490 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:33.555076 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1644e12a-5d79-45e0-9b68-6d371f2ab490 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:33.557247 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-1644e12a-5d79-45e0-9b68-6d371f2ab490 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:33.558698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1644e12a-5d79-45e0-9b68-6d371f2ab490 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1406 microversion: 2.20 time: 0.215110 May 17 18:25:33.559449 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 468/882] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:33 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1406 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:33.700307 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f84b576f-4af8-4a8a-b099-9c18caf7ede2 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:33.700922 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f84b576f-4af8-4a8a-b099-9c18caf7ede2 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:33.706829 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f84b576f-4af8-4a8a-b099-9c18caf7ede2 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:33.707283 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f84b576f-4af8-4a8a-b099-9c18caf7ede2 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:33.708421 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f84b576f-4af8-4a8a-b099-9c18caf7ede2 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:33.708867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f84b576f-4af8-4a8a-b099-9c18caf7ede2 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:33.837185 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f84b576f-4af8-4a8a-b099-9c18caf7ede2 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:33.846201 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f84b576f-4af8-4a8a-b099-9c18caf7ede2 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1364 microversion: 2.1 time: 0.148794 May 17 18:25:33.846201 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 415/883] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:33 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:34.312964 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-694ca249-047b-453f-86b1-dbcb110ce648 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:34.313514 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-694ca249-047b-453f-86b1-dbcb110ce648 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] [instance: 01e82dfe-21e6-427a-82b1-0b2362423057] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:34.319713 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-694ca249-047b-453f-86b1-dbcb110ce648 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:34.320192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-694ca249-047b-453f-86b1-dbcb110ce648 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:34.320960 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-694ca249-047b-453f-86b1-dbcb110ce648 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:34.321394 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-694ca249-047b-453f-86b1-dbcb110ce648 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:34.335297 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-694ca249-047b-453f-86b1-dbcb110ce648 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] HTTP exception thrown: Instance 01e82dfe-21e6-427a-82b1-0b2362423057 could not be found. May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-694ca249-047b-453f-86b1-dbcb110ce648 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Request method failure captured: May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 HTTP/1.1 May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bPT5PJb4v2TtchlazaTc4tsgElmPs7hEcTqQ-3XK5tZM_VLzGHdXJdr2rSJCb1gYx1SrW3nB-whM3bgmSozRTJNa1tqgL318uDZXw6jKtkeLg2QsgmksivrEql1pdoXv8CkKOVUB4re9ufg_nU903_wvc0E5GAJ53_vzIvqUBewKo May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: b7d713a65f9e4071988e5df2fbf90b17 May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:25:34.336904 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/b7d713a65f9e4071988e5df2fbf90b17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: b7d713a65f9e4071988e5df2fbf90b17 May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-510098100 May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-ServerRescueNegativeTestJSON-510098100-project May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 5e6f035cadd24a59803eec21c7b9e2c5 May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-ServerRescueNegativeTestJSON-510098100-project May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 01e82dfe-21e6-427a-82b1-0b2362423057 could not be found. May 17 18:25:34.338462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '01e82dfe-21e6-427a-82b1-0b2362423057'} May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01e82dfe-21e6-427a-82b1-0b2362423057 could not be found. May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:25:34.339301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01e82dfe-21e6-427a-82b1-0b2362423057 could not be found. May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01e82dfe-21e6-427a-82b1-0b2362423057 could not be found. May 17 18:25:34.340454 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:25:34.341511 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-694ca249-047b-453f-86b1-dbcb110ce648 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] Returning 404 to user: Instance 01e82dfe-21e6-427a-82b1-0b2362423057 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:25:34.341511 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-694ca249-047b-453f-86b1-dbcb110ce648 tempest-ServerRescueNegativeTestJSON-510098100 tempest-ServerRescueNegativeTestJSON-510098100-project] 10.222.0.65 "GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057" status: 404 len: 111 microversion: 2.1 time: 0.029529 May 17 18:25:34.341511 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 469/884] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:34 2022] GET /compute/v2.1/servers/01e82dfe-21e6-427a-82b1-0b2362423057 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:25:34.577962 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ed7dfaaf-5df9-4278-ab0a-3085f3d3add2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:34.579257 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ed7dfaaf-5df9-4278-ab0a-3085f3d3add2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:34.585299 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ed7dfaaf-5df9-4278-ab0a-3085f3d3add2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:34.585931 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ed7dfaaf-5df9-4278-ab0a-3085f3d3add2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:34.586739 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ed7dfaaf-5df9-4278-ab0a-3085f3d3add2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:34.587182 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ed7dfaaf-5df9-4278-ab0a-3085f3d3add2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:34.717768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ed7dfaaf-5df9-4278-ab0a-3085f3d3add2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:34.725427 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ed7dfaaf-5df9-4278-ab0a-3085f3d3add2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:34.726937 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ed7dfaaf-5df9-4278-ab0a-3085f3d3add2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:34.728064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ed7dfaaf-5df9-4278-ab0a-3085f3d3add2 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1406 microversion: 2.20 time: 0.154996 May 17 18:25:34.728810 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 416/885] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:34 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:34.861564 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-afe02681-b0dc-42b3-8ee5-ffb7a23501c8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:34.862176 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-afe02681-b0dc-42b3-8ee5-ffb7a23501c8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:34.868408 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afe02681-b0dc-42b3-8ee5-ffb7a23501c8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:34.868858 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afe02681-b0dc-42b3-8ee5-ffb7a23501c8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:34.869654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afe02681-b0dc-42b3-8ee5-ffb7a23501c8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:34.870093 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afe02681-b0dc-42b3-8ee5-ffb7a23501c8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:34.996468 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-afe02681-b0dc-42b3-8ee5-ffb7a23501c8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:35.004698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-afe02681-b0dc-42b3-8ee5-ffb7a23501c8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1364 microversion: 2.1 time: 0.146822 May 17 18:25:35.005266 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 470/886] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:34 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:35.747525 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6cfb2211-9fe5-42d4-af2c-74359b8e86e0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:35.748927 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6cfb2211-9fe5-42d4-af2c-74359b8e86e0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:35.755623 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6cfb2211-9fe5-42d4-af2c-74359b8e86e0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:35.756193 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6cfb2211-9fe5-42d4-af2c-74359b8e86e0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:35.757070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6cfb2211-9fe5-42d4-af2c-74359b8e86e0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:35.757665 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6cfb2211-9fe5-42d4-af2c-74359b8e86e0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:35.895636 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6cfb2211-9fe5-42d4-af2c-74359b8e86e0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:35.903906 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6cfb2211-9fe5-42d4-af2c-74359b8e86e0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:35.906342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6cfb2211-9fe5-42d4-af2c-74359b8e86e0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:35.907517 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6cfb2211-9fe5-42d4-af2c-74359b8e86e0 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1599 microversion: 2.20 time: 0.164210 May 17 18:25:35.908069 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 417/887] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:25:35 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:25:35.926350 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9755c783-0e33-4f3f-8754-e324c46eedcf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:35.926929 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9755c783-0e33-4f3f-8754-e324c46eedcf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:35.933520 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9755c783-0e33-4f3f-8754-e324c46eedcf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:35.934170 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9755c783-0e33-4f3f-8754-e324c46eedcf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:35.944641 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9755c783-0e33-4f3f-8754-e324c46eedcf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:35.945999 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9755c783-0e33-4f3f-8754-e324c46eedcf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:36.022873 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-534d084e-73a3-4781-b122-332d90e6a62d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:36.023628 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-534d084e-73a3-4781-b122-332d90e6a62d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:36.041953 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9755c783-0e33-4f3f-8754-e324c46eedcf tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.120239 May 17 18:25:36.043281 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 471/888] 10.222.0.65 () {60 vars in 1315 bytes} [Tue May 17 18:25:35 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:25:36.043986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-534d084e-73a3-4781-b122-332d90e6a62d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:36.044813 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-534d084e-73a3-4781-b122-332d90e6a62d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:36.045825 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-534d084e-73a3-4781-b122-332d90e6a62d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:36.046435 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-534d084e-73a3-4781-b122-332d90e6a62d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:36.158888 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-9bb5bd69-4cf5-4a45-becc-f6f5e3ca1cd1 req-25dc5aaf-758b-4946-9420-00e5df5a1118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e325b5f-1d56-4055-829d-f41198c02382", "name": "network-vif-plugged", "status": "completed", "tag": "cc3e9b30-1b25-4bea-a3bb-d2e98cb94f96"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:36.178160 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-9bb5bd69-4cf5-4a45-becc-f6f5e3ca1cd1 req-25dc5aaf-758b-4946-9420-00e5df5a1118 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:36.179644 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-9bb5bd69-4cf5-4a45-becc-f6f5e3ca1cd1 req-25dc5aaf-758b-4946-9420-00e5df5a1118 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:36.197940 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-9bb5bd69-4cf5-4a45-becc-f6f5e3ca1cd1 req-25dc5aaf-758b-4946-9420-00e5df5a1118 service nova] Creating event network-vif-plugged:cc3e9b30-1b25-4bea-a3bb-d2e98cb94f96 for instance 8e325b5f-1d56-4055-829d-f41198c02382 on hv-cinder-83736 May 17 18:25:36.206758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-9bb5bd69-4cf5-4a45-becc-f6f5e3ca1cd1 req-25dc5aaf-758b-4946-9420-00e5df5a1118 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051549 May 17 18:25:36.207554 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 472/889] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:25:36.228082 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-534d084e-73a3-4781-b122-332d90e6a62d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:36.236470 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-534d084e-73a3-4781-b122-332d90e6a62d tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1364 microversion: 2.1 time: 0.218093 May 17 18:25:36.237497 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 418/890] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:36 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:25:37.255362 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b8eb1a3f-5811-4b3a-8574-32e494e6bbbf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:37.256985 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b8eb1a3f-5811-4b3a-8574-32e494e6bbbf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:37.264668 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b8eb1a3f-5811-4b3a-8574-32e494e6bbbf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:37.265211 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b8eb1a3f-5811-4b3a-8574-32e494e6bbbf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:37.266348 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b8eb1a3f-5811-4b3a-8574-32e494e6bbbf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:37.266855 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b8eb1a3f-5811-4b3a-8574-32e494e6bbbf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:37.405083 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b8eb1a3f-5811-4b3a-8574-32e494e6bbbf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:37.412829 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b8eb1a3f-5811-4b3a-8574-32e494e6bbbf tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1364 microversion: 2.1 time: 0.163183 May 17 18:25:37.413633 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 473/891] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:37 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:37.679228 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-670dd4d2-f29a-4ffc-8b8b-0fcb9b2300cd req-f13ec18a-a526-46ce-ba73-69a0b94611e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54d4de87-f1c0-4e32-9c17-09a87a23dc55", "tag": "9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:37.696640 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-670dd4d2-f29a-4ffc-8b8b-0fcb9b2300cd req-f13ec18a-a526-46ce-ba73-69a0b94611e9 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:37.697474 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-670dd4d2-f29a-4ffc-8b8b-0fcb9b2300cd req-f13ec18a-a526-46ce-ba73-69a0b94611e9 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:37.709810 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-670dd4d2-f29a-4ffc-8b8b-0fcb9b2300cd req-f13ec18a-a526-46ce-ba73-69a0b94611e9 service nova] Creating event network-changed:9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f for instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 on hv-cinder-83736 May 17 18:25:37.715342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-670dd4d2-f29a-4ffc-8b8b-0fcb9b2300cd req-f13ec18a-a526-46ce-ba73-69a0b94611e9 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040270 May 17 18:25:37.716392 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 419/892] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:38.430826 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9429265d-fb0c-41bc-9990-609d48155ca8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:38.431533 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9429265d-fb0c-41bc-9990-609d48155ca8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:38.441327 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9429265d-fb0c-41bc-9990-609d48155ca8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:38.442245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9429265d-fb0c-41bc-9990-609d48155ca8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:38.444848 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9429265d-fb0c-41bc-9990-609d48155ca8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:38.445481 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9429265d-fb0c-41bc-9990-609d48155ca8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:38.658637 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-9429265d-fb0c-41bc-9990-609d48155ca8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:38.667976 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9429265d-fb0c-41bc-9990-609d48155ca8 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1364 microversion: 2.1 time: 0.241410 May 17 18:25:38.687518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 474/893] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:38 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:39.688158 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d846af90-a4a2-41dd-b60d-cdd130f0986e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:39.689525 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d846af90-a4a2-41dd-b60d-cdd130f0986e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:39.699425 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d846af90-a4a2-41dd-b60d-cdd130f0986e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:39.700581 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d846af90-a4a2-41dd-b60d-cdd130f0986e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:39.701822 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d846af90-a4a2-41dd-b60d-cdd130f0986e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:39.702436 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d846af90-a4a2-41dd-b60d-cdd130f0986e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:39.854312 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d846af90-a4a2-41dd-b60d-cdd130f0986e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:25:39.861540 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d846af90-a4a2-41dd-b60d-cdd130f0986e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1549 microversion: 2.1 time: 0.179707 May 17 18:25:39.862099 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 420/894] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:25:39 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1549 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:25:39.878055 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-90c60d42-ef28-4393-b546-ad883d80d2eb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:25:39.878670 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-90c60d42-ef28-4393-b546-ad883d80d2eb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:25:39.884986 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90c60d42-ef28-4393-b546-ad883d80d2eb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:39.885628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90c60d42-ef28-4393-b546-ad883d80d2eb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:39.887042 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90c60d42-ef28-4393-b546-ad883d80d2eb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:39.887545 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-90c60d42-ef28-4393-b546-ad883d80d2eb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:39.975752 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-90c60d42-ef28-4393-b546-ad883d80d2eb tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101469 May 17 18:25:39.976519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 475/895] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 17 18:25:39 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:25:40.936531 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-70b63d0b-3ef9-4950-b714-b97c993bea1e req-422d38e8-97fd-48b4-8be6-d147c9dc1959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e325b5f-1d56-4055-829d-f41198c02382", "tag": "cc3e9b30-1b25-4bea-a3bb-d2e98cb94f96"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:25:40.945871 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-70b63d0b-3ef9-4950-b714-b97c993bea1e req-422d38e8-97fd-48b4-8be6-d147c9dc1959 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:25:40.946544 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-70b63d0b-3ef9-4950-b714-b97c993bea1e req-422d38e8-97fd-48b4-8be6-d147c9dc1959 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:25:40.957555 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-70b63d0b-3ef9-4950-b714-b97c993bea1e req-422d38e8-97fd-48b4-8be6-d147c9dc1959 service nova] Creating event network-changed:cc3e9b30-1b25-4bea-a3bb-d2e98cb94f96 for instance 8e325b5f-1d56-4055-829d-f41198c02382 on hv-cinder-83736 May 17 18:25:40.962651 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-70b63d0b-3ef9-4950-b714-b97c993bea1e req-422d38e8-97fd-48b4-8be6-d147c9dc1959 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030250 May 17 18:25:40.963793 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 421/896] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:21.947293 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1073549366", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "networks": [{"uuid": "837d8b04-5531-4d25-8d9f-1ce43ec42ea1"}]}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:21.997027 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.network.neutron [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] validate_networks() for [('837d8b04-5531-4d25-8d9f-1ce43ec42ea1', None, None, None, None, None)] {{(pid=117098) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:26:22.338751 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Flavor limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:26:22.339175 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Image limits 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:26:22.339649 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Flavor pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:26:22.340086 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Image pref 0:0:0 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:26:22.340501 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.virt.hardware [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117098) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:26:22.349209 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:22.349692 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:22.350495 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:22.350935 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:22.367288 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Getting quotas for project 7c88151132894c38874f6c453c9177f6. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:26:22.371183 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Getting quotas for user edb9684cd47f46538fc4faf85bdf29fa and project 7c88151132894c38874f6c453c9177f6. Resources: {'instances', 'ram', 'cores'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:26:22.382443 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Going to run 1 instances... {{(pid=117098) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:26:22.384650 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117098) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:26:22.429148 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b399f889-d456-4c3b-bdf1-e206223ad0fd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486512 May 17 18:26:22.429826 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 476/897] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:26:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:26:22.440985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d812dc91-0b32-4339-a29b-3015da3e6038 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:22.441729 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d812dc91-0b32-4339-a29b-3015da3e6038 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:22.444302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7d81c82d-cc21-424c-a714-b3be998589e5] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 17 18:26:22.496765 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d812dc91-0b32-4339-a29b-3015da3e6038 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:22.503935 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d812dc91-0b32-4339-a29b-3015da3e6038 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1214 microversion: 2.1 time: 0.067086 May 17 18:26:22.504507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 422/898] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:22 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:23.522823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e5f2b2e5-208a-4711-bfcf-553f31b3ed50 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:23.524242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e5f2b2e5-208a-4711-bfcf-553f31b3ed50 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:23.536605 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e5f2b2e5-208a-4711-bfcf-553f31b3ed50 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:23.537055 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e5f2b2e5-208a-4711-bfcf-553f31b3ed50 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:23.537861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e5f2b2e5-208a-4711-bfcf-553f31b3ed50 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:23.538292 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e5f2b2e5-208a-4711-bfcf-553f31b3ed50 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:23.599741 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e5f2b2e5-208a-4711-bfcf-553f31b3ed50 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:23.607692 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e5f2b2e5-208a-4711-bfcf-553f31b3ed50 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1272 microversion: 2.1 time: 0.090913 May 17 18:26:23.608407 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 477/899] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:23 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:24.625128 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ec184c3e-bf04-4baa-a6ef-bd9e0de8652e tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:24.625768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ec184c3e-bf04-4baa-a6ef-bd9e0de8652e tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:24.636074 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO oslo.messaging._drivers.impl_rabbit [-] [7d81c82d-cc21-424c-a714-b3be998589e5] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 53078. May 17 18:26:24.641418 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec184c3e-bf04-4baa-a6ef-bd9e0de8652e tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:24.641893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec184c3e-bf04-4baa-a6ef-bd9e0de8652e tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:24.642669 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec184c3e-bf04-4baa-a6ef-bd9e0de8652e tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:24.643200 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ec184c3e-bf04-4baa-a6ef-bd9e0de8652e tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:24.780287 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ec184c3e-bf04-4baa-a6ef-bd9e0de8652e tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:24.788540 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ec184c3e-bf04-4baa-a6ef-bd9e0de8652e tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1314 microversion: 2.1 time: 0.167151 May 17 18:26:24.789201 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 423/900] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:24 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:24.970853 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-3805f262-60d3-4de0-9743-99971e9e19ee req-cfa7ca46-bbe9-4ca9-b476-f51d663457ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f2b9d9e-6ae9-4827-a320-80407d14dc40", "tag": "be72679b-55e9-43c5-8e6a-262e476879da"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:24.979974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-3805f262-60d3-4de0-9743-99971e9e19ee req-cfa7ca46-bbe9-4ca9-b476-f51d663457ec service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:24.980424 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-3805f262-60d3-4de0-9743-99971e9e19ee req-cfa7ca46-bbe9-4ca9-b476-f51d663457ec service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:24.991843 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-3805f262-60d3-4de0-9743-99971e9e19ee req-cfa7ca46-bbe9-4ca9-b476-f51d663457ec service nova] Creating event network-changed:be72679b-55e9-43c5-8e6a-262e476879da for instance 8f2b9d9e-6ae9-4827-a320-80407d14dc40 on hv-cinder-83736 May 17 18:26:24.996816 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-3805f262-60d3-4de0-9743-99971e9e19ee req-cfa7ca46-bbe9-4ca9-b476-f51d663457ec service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030035 May 17 18:26:24.997396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 478/901] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:26:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:25.428112 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-891f6e08-5b8b-419f-b415-0cc70fc22930 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1114474463"}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:25.428642 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-891f6e08-5b8b-419f-b415-0cc70fc22930 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:25.434649 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-891f6e08-5b8b-419f-b415-0cc70fc22930 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:25.435104 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-891f6e08-5b8b-419f-b415-0cc70fc22930 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:25.436411 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-891f6e08-5b8b-419f-b415-0cc70fc22930 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:25.436851 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-891f6e08-5b8b-419f-b415-0cc70fc22930 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:25.558156 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.network.security_group_api [None req-891f6e08-5b8b-419f-b415-0cc70fc22930 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Removing security group b3a07366-5f97-4c55-a2cf-c20fd251d85c from port cc5efd46-7563-4b9a-9d0d-a824d9fd3faf May 17 18:26:25.806240 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3c07d1a6-9796-4e1c-9566-abeb3e9cb57f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:25.806860 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3c07d1a6-9796-4e1c-9566-abeb3e9cb57f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:25.812962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3c07d1a6-9796-4e1c-9566-abeb3e9cb57f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:25.813412 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3c07d1a6-9796-4e1c-9566-abeb3e9cb57f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:25.814204 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3c07d1a6-9796-4e1c-9566-abeb3e9cb57f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:25.814641 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3c07d1a6-9796-4e1c-9566-abeb3e9cb57f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:26.012231 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-891f6e08-5b8b-419f-b415-0cc70fc22930 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "POST /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/action" status: 202 len: 0 microversion: 2.1 time: 0.587481 May 17 18:26:26.012841 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 424/902] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:26:25 2022] POST /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/action => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:26:26.028432 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-b8dfdbc8-060d-4bcf-8474-5f2eb1995c23 req-60deeacb-3707-4fe1-aa49-f8094f6a4da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e42d88-56d2-431d-9b8a-874306f6895d", "tag": "cc5efd46-7563-4b9a-9d0d-a824d9fd3faf"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:26.042655 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3c07d1a6-9796-4e1c-9566-abeb3e9cb57f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:26.047848 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-b8dfdbc8-060d-4bcf-8474-5f2eb1995c23 req-60deeacb-3707-4fe1-aa49-f8094f6a4da2 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:26.049306 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-b8dfdbc8-060d-4bcf-8474-5f2eb1995c23 req-60deeacb-3707-4fe1-aa49-f8094f6a4da2 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:26.063126 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3c07d1a6-9796-4e1c-9566-abeb3e9cb57f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1314 microversion: 2.1 time: 0.261105 May 17 18:26:26.063823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 479/903] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:25 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:26:26.072508 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-b8dfdbc8-060d-4bcf-8474-5f2eb1995c23 req-60deeacb-3707-4fe1-aa49-f8094f6a4da2 service nova] Creating event network-changed:cc5efd46-7563-4b9a-9d0d-a824d9fd3faf for instance d4e42d88-56d2-431d-9b8a-874306f6895d on hv-cinder-83736 May 17 18:26:26.083383 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-b8dfdbc8-060d-4bcf-8474-5f2eb1995c23 req-60deeacb-3707-4fe1-aa49-f8094f6a4da2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058527 May 17 18:26:26.084458 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 425/904] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:27.035362 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3ef4ccc0-ef1e-4ab1-af85-3643eae7f80b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:27.035865 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3ef4ccc0-ef1e-4ab1-af85-3643eae7f80b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:27.042235 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ef4ccc0-ef1e-4ab1-af85-3643eae7f80b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:27.042694 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ef4ccc0-ef1e-4ab1-af85-3643eae7f80b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:27.043477 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ef4ccc0-ef1e-4ab1-af85-3643eae7f80b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:27.043918 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ef4ccc0-ef1e-4ab1-af85-3643eae7f80b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:27.081670 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-be050083-7017-4927-9cf6-c63bbdd86e13 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:27.082388 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-be050083-7017-4927-9cf6-c63bbdd86e13 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:27.088685 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-be050083-7017-4927-9cf6-c63bbdd86e13 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:27.089372 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-be050083-7017-4927-9cf6-c63bbdd86e13 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:27.090195 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-be050083-7017-4927-9cf6-c63bbdd86e13 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:27.090647 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-be050083-7017-4927-9cf6-c63bbdd86e13 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:27.126462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-3ef4ccc0-ef1e-4ab1-af85-3643eae7f80b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lazy-loading 'services' on Instance uuid d4e42d88-56d2-431d-9b8a-874306f6895d {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:26:27.200680 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3ef4ccc0-ef1e-4ab1-af85-3643eae7f80b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments/4cb29bde-8f57-4fc0-b463-e98e6b273913" status: 202 len: 0 microversion: 2.1 time: 0.168791 May 17 18:26:27.202416 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 480/905] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:26:27 2022] DELETE /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments/4cb29bde-8f57-4fc0-b463-e98e6b273913 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:26:27.210736 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-977c19e7-dda3-427f-affc-cb5703e0e8d3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:27.212057 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-977c19e7-dda3-427f-affc-cb5703e0e8d3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:27.218470 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-977c19e7-dda3-427f-affc-cb5703e0e8d3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:27.218941 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-977c19e7-dda3-427f-affc-cb5703e0e8d3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:27.219721 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-977c19e7-dda3-427f-affc-cb5703e0e8d3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:27.220171 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-977c19e7-dda3-427f-affc-cb5703e0e8d3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:27.227492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-be050083-7017-4927-9cf6-c63bbdd86e13 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:27.234844 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-be050083-7017-4927-9cf6-c63bbdd86e13 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1314 microversion: 2.1 time: 0.157968 May 17 18:26:27.235731 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 426/906] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:27 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:26:27.250663 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-977c19e7-dda3-427f-affc-cb5703e0e8d3 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044016 May 17 18:26:27.251212 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 481/907] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:26:27 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:26:28.100002 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-db8384f4-62b4-43d2-b240-04a041f109da req-5a88d703-ae3e-42ae-9252-268fc8cdc467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e42d88-56d2-431d-9b8a-874306f6895d", "tag": "cc5efd46-7563-4b9a-9d0d-a824d9fd3faf"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:28.108932 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-db8384f4-62b4-43d2-b240-04a041f109da req-5a88d703-ae3e-42ae-9252-268fc8cdc467 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:28.109374 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-db8384f4-62b4-43d2-b240-04a041f109da req-5a88d703-ae3e-42ae-9252-268fc8cdc467 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:28.119842 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-db8384f4-62b4-43d2-b240-04a041f109da req-5a88d703-ae3e-42ae-9252-268fc8cdc467 service nova] Creating event network-changed:cc5efd46-7563-4b9a-9d0d-a824d9fd3faf for instance d4e42d88-56d2-431d-9b8a-874306f6895d on hv-cinder-83736 May 17 18:26:28.124591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-db8384f4-62b4-43d2-b240-04a041f109da req-5a88d703-ae3e-42ae-9252-268fc8cdc467 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028238 May 17 18:26:28.125145 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 427/908] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:28.251939 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f26ce007-51fa-4733-9272-2a2a1915f861 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:28.252583 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f26ce007-51fa-4733-9272-2a2a1915f861 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:28.259498 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f26ce007-51fa-4733-9272-2a2a1915f861 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:28.259955 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f26ce007-51fa-4733-9272-2a2a1915f861 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:28.260739 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f26ce007-51fa-4733-9272-2a2a1915f861 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:28.261177 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f26ce007-51fa-4733-9272-2a2a1915f861 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:28.263803 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b0bb01d2-ebfc-4f6c-bfc0-6ea19711aaea tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:28.264817 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b0bb01d2-ebfc-4f6c-bfc0-6ea19711aaea tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:28.270857 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0bb01d2-ebfc-4f6c-bfc0-6ea19711aaea tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:28.271308 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0bb01d2-ebfc-4f6c-bfc0-6ea19711aaea tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:28.272087 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0bb01d2-ebfc-4f6c-bfc0-6ea19711aaea tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:28.272532 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b0bb01d2-ebfc-4f6c-bfc0-6ea19711aaea tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:28.301177 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b0bb01d2-ebfc-4f6c-bfc0-6ea19711aaea tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042069 May 17 18:26:28.301787 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 428/909] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:26:28 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:26:28.391466 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f26ce007-51fa-4733-9272-2a2a1915f861 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:28.398771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f26ce007-51fa-4733-9272-2a2a1915f861 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1314 microversion: 2.1 time: 0.150885 May 17 18:26:28.399335 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 482/910] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:28 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:29.313479 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-69c48140-2801-4878-b488-042591ded8d2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:29.314414 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-69c48140-2801-4878-b488-042591ded8d2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:29.320714 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-69c48140-2801-4878-b488-042591ded8d2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:29.321761 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-69c48140-2801-4878-b488-042591ded8d2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:29.323001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-69c48140-2801-4878-b488-042591ded8d2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:29.323001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-69c48140-2801-4878-b488-042591ded8d2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:29.350871 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-69c48140-2801-4878-b488-042591ded8d2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042077 May 17 18:26:29.351459 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 429/911] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:26:29 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:26:29.361769 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9d43788f-8520-48a3-b3b0-91859e2a8dc2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:29.362344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-9d43788f-8520-48a3-b3b0-91859e2a8dc2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:29.368534 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9d43788f-8520-48a3-b3b0-91859e2a8dc2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:29.368991 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9d43788f-8520-48a3-b3b0-91859e2a8dc2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:29.369842 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9d43788f-8520-48a3-b3b0-91859e2a8dc2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:29.370287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-9d43788f-8520-48a3-b3b0-91859e2a8dc2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:29.415959 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1631e4c2-cabe-4241-b47b-a079e70fa84f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:29.416618 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1631e4c2-cabe-4241-b47b-a079e70fa84f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:29.423456 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1631e4c2-cabe-4241-b47b-a079e70fa84f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:29.423911 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1631e4c2-cabe-4241-b47b-a079e70fa84f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:29.424892 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1631e4c2-cabe-4241-b47b-a079e70fa84f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:29.425526 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1631e4c2-cabe-4241-b47b-a079e70fa84f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:29.456519 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-9d43788f-8520-48a3-b3b0-91859e2a8dc2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] HTTP exception thrown: Instance d4e42d88-56d2-431d-9b8a-874306f6895d is not attached to volume 4cb29bde-8f57-4fc0-b463-e98e6b273913 May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9d43788f-8520-48a3-b3b0-91859e2a8dc2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Request method failure captured: May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: DELETE /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments/4cb29bde-8f57-4fc0-b463-e98e6b273913 HTTP/1.1 May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-fenSrH3Rz8br8aAWHbVj56iGPzcv_jFN3iVvy2b54nbV-SEgmDPNJiSlCmcGTZASIsF1rG72AEiL5pzy0cuXffd_UJ-CmnhBWwgKpCz2dWch3O6uQozBsD_ovLDy3tiRcds6nh1GePQhjRAnUfgNsRF2p85ug1ENy5X_F3YqV0JgY May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 271959139e4a4e058a5a56cbdfc8cdcb May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-TestMinimumBasicScenario-1415861914 May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:26:29.464447 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:26:29.466192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_271959139e4a4e058a5a56cbdfc8cdcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/271959139e4a4e058a5a56cbdfc8cdcb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/271959139e4a4e058a5a56cbdfc8cdcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/271959139e4a4e058a5a56cbdfc8cdcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:26:29.466192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-TestMinimumBasicScenario-1415861914 May 17 18:26:29.466192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 271959139e4a4e058a5a56cbdfc8cdcb May 17 18:26:29.466192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1415861914 May 17 18:26:29.466192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-TestMinimumBasicScenario-1415861914-project May 17 18:26:29.466192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:26:29.466192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:26:29.466192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 5dee3ac46621470a9b5fac6574820e93 May 17 18:26:29.466192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-TestMinimumBasicScenario-1415861914-project May 17 18:26:29.466192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:26:29.466192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance d4e42d88-56d2-431d-9b8a-874306f6895d is not attached to volume 4cb29bde-8f57-4fc0-b463-e98e6b273913 May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'server_id': 'd4e42d88-56d2-431d-9b8a-874306f6895d', 'id': '4cb29bde-8f57-4fc0-b463-e98e6b273913'} May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 4cb29bde-8f57-4fc0-b463-e98e6b273913. May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:26:29.469970 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e42d88-56d2-431d-9b8a-874306f6895d is not attached to volume 4cb29bde-8f57-4fc0-b463-e98e6b273913 May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e42d88-56d2-431d-9b8a-874306f6895d is not attached to volume 4cb29bde-8f57-4fc0-b463-e98e6b273913 May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:26:29.471504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-9d43788f-8520-48a3-b3b0-91859e2a8dc2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Returning 404 to user: Instance d4e42d88-56d2-431d-9b8a-874306f6895d is not attached to volume 4cb29bde-8f57-4fc0-b463-e98e6b273913 {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:26:29.472671 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-9d43788f-8520-48a3-b3b0-91859e2a8dc2 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments/4cb29bde-8f57-4fc0-b463-e98e6b273913" status: 404 len: 154 microversion: 2.1 time: 0.108983 May 17 18:26:29.472671 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 483/912] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:26:29 2022] DELETE /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d/os-volume_attachments/4cb29bde-8f57-4fc0-b463-e98e6b273913 => generated 154 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:26:29.567726 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1631e4c2-cabe-4241-b47b-a079e70fa84f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:29.575835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1631e4c2-cabe-4241-b47b-a079e70fa84f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1314 microversion: 2.1 time: 0.163465 May 17 18:26:29.576526 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 430/913] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:29 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:26:30.592678 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5bef7c01-3816-4887-8a6b-ccf856ff8d62 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:30.593822 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5bef7c01-3816-4887-8a6b-ccf856ff8d62 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:30.601722 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5bef7c01-3816-4887-8a6b-ccf856ff8d62 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:30.602844 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5bef7c01-3816-4887-8a6b-ccf856ff8d62 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:30.603113 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5bef7c01-3816-4887-8a6b-ccf856ff8d62 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:30.603386 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5bef7c01-3816-4887-8a6b-ccf856ff8d62 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:30.612150 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c9ecd18f-a96c-4f4f-92e1-341a1d66c764 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:30.612688 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c9ecd18f-a96c-4f4f-92e1-341a1d66c764 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:30.618864 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c9ecd18f-a96c-4f4f-92e1-341a1d66c764 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:30.619312 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c9ecd18f-a96c-4f4f-92e1-341a1d66c764 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:30.620079 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c9ecd18f-a96c-4f4f-92e1-341a1d66c764 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:30.620516 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c9ecd18f-a96c-4f4f-92e1-341a1d66c764 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:30.644886 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c9ecd18f-a96c-4f4f-92e1-341a1d66c764 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:26:30.720350 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c9ecd18f-a96c-4f4f-92e1-341a1d66c764 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "DELETE /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 204 len: 0 microversion: 2.1 time: 0.112032 May 17 18:26:30.720981 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 431/914] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:26:30 2022] DELETE /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 17 18:26:30.729619 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a73c72fa-8b07-42b2-a7e0-1c09ff0d59d7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:30.730410 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a73c72fa-8b07-42b2-a7e0-1c09ff0d59d7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:30.736329 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a73c72fa-8b07-42b2-a7e0-1c09ff0d59d7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:30.736633 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a73c72fa-8b07-42b2-a7e0-1c09ff0d59d7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:30.737404 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a73c72fa-8b07-42b2-a7e0-1c09ff0d59d7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:30.737867 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a73c72fa-8b07-42b2-a7e0-1c09ff0d59d7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:30.738938 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5bef7c01-3816-4887-8a6b-ccf856ff8d62 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:30.746350 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5bef7c01-3816-4887-8a6b-ccf856ff8d62 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1314 microversion: 2.1 time: 0.158314 May 17 18:26:30.746919 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 484/915] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:30 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:30.865559 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a73c72fa-8b07-42b2-a7e0-1c09ff0d59d7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:30.873314 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a73c72fa-8b07-42b2-a7e0-1c09ff0d59d7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1553 microversion: 2.1 time: 0.147277 May 17 18:26:30.874253 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 432/916] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:30 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:26:31.763272 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0c70a589-8ff4-46d5-abcf-33713b16150f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:31.763915 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0c70a589-8ff4-46d5-abcf-33713b16150f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:31.770224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0c70a589-8ff4-46d5-abcf-33713b16150f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:31.770673 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0c70a589-8ff4-46d5-abcf-33713b16150f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:31.771435 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0c70a589-8ff4-46d5-abcf-33713b16150f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:31.771871 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0c70a589-8ff4-46d5-abcf-33713b16150f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:31.890598 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a0296982-6724-4b01-bc51-7bf7ea50e924 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:31.891309 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a0296982-6724-4b01-bc51-7bf7ea50e924 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:31.897762 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0296982-6724-4b01-bc51-7bf7ea50e924 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:31.898220 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0296982-6724-4b01-bc51-7bf7ea50e924 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:31.898992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0296982-6724-4b01-bc51-7bf7ea50e924 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:31.899432 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0296982-6724-4b01-bc51-7bf7ea50e924 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:31.905821 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0c70a589-8ff4-46d5-abcf-33713b16150f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:31.913023 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0c70a589-8ff4-46d5-abcf-33713b16150f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1314 microversion: 2.1 time: 0.153632 May 17 18:26:31.913803 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 485/917] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:31 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:32.023910 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a0296982-6724-4b01-bc51-7bf7ea50e924 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:32.031725 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a0296982-6724-4b01-bc51-7bf7ea50e924 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1553 microversion: 2.1 time: 0.145068 May 17 18:26:32.032292 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 433/918] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:31 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1553 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:26:32.315470 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-3e7ea756-be36-4175-8976-d23abf9fc48b req-11c0aedb-69f6-4032-80a3-36e4c183c9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2b9d9e-6ae9-4827-a320-80407d14dc40", "name": "network-vif-plugged", "status": "completed", "tag": "be72679b-55e9-43c5-8e6a-262e476879da"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:32.325010 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-3e7ea756-be36-4175-8976-d23abf9fc48b req-11c0aedb-69f6-4032-80a3-36e4c183c9bb service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:32.326232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-3e7ea756-be36-4175-8976-d23abf9fc48b req-11c0aedb-69f6-4032-80a3-36e4c183c9bb service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:32.337240 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-3e7ea756-be36-4175-8976-d23abf9fc48b req-11c0aedb-69f6-4032-80a3-36e4c183c9bb service nova] Creating event network-vif-plugged:be72679b-55e9-43c5-8e6a-262e476879da for instance 8f2b9d9e-6ae9-4827-a320-80407d14dc40 on hv-cinder-83736 May 17 18:26:32.342767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-3e7ea756-be36-4175-8976-d23abf9fc48b req-11c0aedb-69f6-4032-80a3-36e4c183c9bb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031086 May 17 18:26:32.343705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 486/919] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:26:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:32.930273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-271f83d7-db54-487b-816c-69dae8217d7a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:32.930819 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-271f83d7-db54-487b-816c-69dae8217d7a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:32.937825 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-271f83d7-db54-487b-816c-69dae8217d7a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:32.938278 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-271f83d7-db54-487b-816c-69dae8217d7a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:32.939045 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-271f83d7-db54-487b-816c-69dae8217d7a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:32.939487 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-271f83d7-db54-487b-816c-69dae8217d7a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:33.049139 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c7e4719a-bc36-40fe-bae3-ad404ea49fba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:33.050461 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c7e4719a-bc36-40fe-bae3-ad404ea49fba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:33.057748 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7e4719a-bc36-40fe-bae3-ad404ea49fba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:33.058208 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7e4719a-bc36-40fe-bae3-ad404ea49fba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:33.058963 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7e4719a-bc36-40fe-bae3-ad404ea49fba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:33.059399 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7e4719a-bc36-40fe-bae3-ad404ea49fba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:33.065296 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-271f83d7-db54-487b-816c-69dae8217d7a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:33.074586 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-271f83d7-db54-487b-816c-69dae8217d7a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1314 microversion: 2.1 time: 0.148242 May 17 18:26:33.077758 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 434/920] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:32 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:33.204315 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c7e4719a-bc36-40fe-bae3-ad404ea49fba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:33.211626 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c7e4719a-bc36-40fe-bae3-ad404ea49fba tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1553 microversion: 2.1 time: 0.167219 May 17 18:26:33.212193 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 487/921] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:33 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:26:33.485737 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-6382ed3d-3cb6-40cf-90ec-743869931b06 req-69e07351-7e21-4891-9d58-51ec92b1f7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e42d88-56d2-431d-9b8a-874306f6895d", "name": "network-vif-deleted", "tag": "cc5efd46-7563-4b9a-9d0d-a824d9fd3faf"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:33.493685 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-6382ed3d-3cb6-40cf-90ec-743869931b06 req-69e07351-7e21-4891-9d58-51ec92b1f7a3 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:33.494136 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-6382ed3d-3cb6-40cf-90ec-743869931b06 req-69e07351-7e21-4891-9d58-51ec92b1f7a3 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:33.506069 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-6382ed3d-3cb6-40cf-90ec-743869931b06 req-69e07351-7e21-4891-9d58-51ec92b1f7a3 service nova] Creating event network-vif-deleted:cc5efd46-7563-4b9a-9d0d-a824d9fd3faf for instance d4e42d88-56d2-431d-9b8a-874306f6895d on hv-cinder-83736 May 17 18:26:33.510841 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-6382ed3d-3cb6-40cf-90ec-743869931b06 req-69e07351-7e21-4891-9d58-51ec92b1f7a3 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029394 May 17 18:26:33.511408 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 435/922] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:34.091693 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-750e5acb-123d-497e-9374-ab937fbd2b9b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:34.092247 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-750e5acb-123d-497e-9374-ab937fbd2b9b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:34.098582 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-750e5acb-123d-497e-9374-ab937fbd2b9b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:34.099030 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-750e5acb-123d-497e-9374-ab937fbd2b9b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:34.099791 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-750e5acb-123d-497e-9374-ab937fbd2b9b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:34.100227 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-750e5acb-123d-497e-9374-ab937fbd2b9b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:34.230280 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3fb0c9c8-c934-4277-b6d5-af61e7d6cc3b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:34.231085 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-3fb0c9c8-c934-4277-b6d5-af61e7d6cc3b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:34.237273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3fb0c9c8-c934-4277-b6d5-af61e7d6cc3b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:34.237836 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3fb0c9c8-c934-4277-b6d5-af61e7d6cc3b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:34.238738 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3fb0c9c8-c934-4277-b6d5-af61e7d6cc3b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:34.239136 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-750e5acb-123d-497e-9374-ab937fbd2b9b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:34.239302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3fb0c9c8-c934-4277-b6d5-af61e7d6cc3b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:34.246825 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-750e5acb-123d-497e-9374-ab937fbd2b9b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1314 microversion: 2.1 time: 0.159067 May 17 18:26:34.247900 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 488/923] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:34 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:34.270522 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3fb0c9c8-c934-4277-b6d5-af61e7d6cc3b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:34.270959 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3fb0c9c8-c934-4277-b6d5-af61e7d6cc3b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:34.271410 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-3fb0c9c8-c934-4277-b6d5-af61e7d6cc3b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lazy-loading 'fault' on Instance uuid d4e42d88-56d2-431d-9b8a-874306f6895d {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:26:34.311682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-3fb0c9c8-c934-4277-b6d5-af61e7d6cc3b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5dee3ac46621470a9b5fac6574820e93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '271959139e4a4e058a5a56cbdfc8cdcb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:34.318888 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-3fb0c9c8-c934-4277-b6d5-af61e7d6cc3b tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 200 len: 1347 microversion: 2.1 time: 0.093358 May 17 18:26:34.319453 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 436/924] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:34 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 1347 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:26:35.265018 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a6472ded-326f-48b1-a439-98fed9296085 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:35.265663 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a6472ded-326f-48b1-a439-98fed9296085 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:35.271962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a6472ded-326f-48b1-a439-98fed9296085 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:35.272409 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a6472ded-326f-48b1-a439-98fed9296085 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:35.273166 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a6472ded-326f-48b1-a439-98fed9296085 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:35.273626 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a6472ded-326f-48b1-a439-98fed9296085 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:35.336223 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-84e2e4d0-0b80-4f14-9249-9639a8baf613 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:35.336829 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-84e2e4d0-0b80-4f14-9249-9639a8baf613 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] [instance: d4e42d88-56d2-431d-9b8a-874306f6895d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:35.343205 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-84e2e4d0-0b80-4f14-9249-9639a8baf613 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:35.343667 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-84e2e4d0-0b80-4f14-9249-9639a8baf613 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:35.344439 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-84e2e4d0-0b80-4f14-9249-9639a8baf613 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:35.344878 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-84e2e4d0-0b80-4f14-9249-9639a8baf613 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:35.358834 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-84e2e4d0-0b80-4f14-9249-9639a8baf613 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] HTTP exception thrown: Instance d4e42d88-56d2-431d-9b8a-874306f6895d could not be found. May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-84e2e4d0-0b80-4f14-9249-9639a8baf613 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Request method failure captured: May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d HTTP/1.1 May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-fenSrH3Rz8br8aAWHbVj56iGPzcv_jFN3iVvy2b54nbV-SEgmDPNJiSlCmcGTZASIsF1rG72AEiL5pzy0cuXffd_UJ-CmnhBWwgKpCz2dWch3O6uQozBsD_ovLDy3tiRcds6nh1GePQhjRAnUfgNsRF2p85ug1ENy5X_F3YqV0JgY May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 271959139e4a4e058a5a56cbdfc8cdcb May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-TestMinimumBasicScenario-1415861914 May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:26:35.360507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_271959139e4a4e058a5a56cbdfc8cdcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/271959139e4a4e058a5a56cbdfc8cdcb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/271959139e4a4e058a5a56cbdfc8cdcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/271959139e4a4e058a5a56cbdfc8cdcb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-TestMinimumBasicScenario-1415861914 May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 271959139e4a4e058a5a56cbdfc8cdcb May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1415861914 May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-TestMinimumBasicScenario-1415861914-project May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 5dee3ac46621470a9b5fac6574820e93 May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-TestMinimumBasicScenario-1415861914-project May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance d4e42d88-56d2-431d-9b8a-874306f6895d could not be found. May 17 18:26:35.361985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': 'd4e42d88-56d2-431d-9b8a-874306f6895d'} May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e42d88-56d2-431d-9b8a-874306f6895d could not be found. May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:26:35.362715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e42d88-56d2-431d-9b8a-874306f6895d could not be found. May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e42d88-56d2-431d-9b8a-874306f6895d could not be found. May 17 18:26:35.364187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:26:35.366197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-84e2e4d0-0b80-4f14-9249-9639a8baf613 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Returning 404 to user: Instance d4e42d88-56d2-431d-9b8a-874306f6895d could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:26:35.366197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-84e2e4d0-0b80-4f14-9249-9639a8baf613 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d" status: 404 len: 111 microversion: 2.1 time: 0.029545 May 17 18:26:35.366197 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 437/925] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:35 2022] GET /compute/v2.1/servers/d4e42d88-56d2-431d-9b8a-874306f6895d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 18:26:35.370353 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5669948f-6286-4679-8dc8-72eeeb344cb7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] Calling method '.version_select at 0x7f4e60237ca0>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:35.387955 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5669948f-6286-4679-8dc8-72eeeb344cb7 tempest-TestMinimumBasicScenario-1415861914 tempest-TestMinimumBasicScenario-1415861914-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-453530016" status: 202 len: 0 microversion: 2.1 time: 0.021097 May 17 18:26:35.388563 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 438/926] 10.222.0.65 () {58 vars in 1268 bytes} [Tue May 17 18:26:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-453530016 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:26:35.401773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a6472ded-326f-48b1-a439-98fed9296085 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:35.409585 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a6472ded-326f-48b1-a439-98fed9296085 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1498 microversion: 2.1 time: 0.148360 May 17 18:26:35.410139 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 489/927] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:35 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:35.795152 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4c7809bb-530c-4fdf-9d2b-6eba9b00eeea tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:35.795663 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4c7809bb-530c-4fdf-9d2b-6eba9b00eeea tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:35.801915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4c7809bb-530c-4fdf-9d2b-6eba9b00eeea tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:35.802440 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4c7809bb-530c-4fdf-9d2b-6eba9b00eeea tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:35.803547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4c7809bb-530c-4fdf-9d2b-6eba9b00eeea tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:35.804295 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4c7809bb-530c-4fdf-9d2b-6eba9b00eeea tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:35.831011 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4c7809bb-530c-4fdf-9d2b-6eba9b00eeea tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:26:35.910425 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4c7809bb-530c-4fdf-9d2b-6eba9b00eeea tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 204 len: 0 microversion: 2.1 time: 0.119618 May 17 18:26:35.911079 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 439/928] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:26:35 2022] DELETE /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:26:35.920630 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-25a3e216-a43d-4738-ab92-91a951f173fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:35.921274 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-25a3e216-a43d-4738-ab92-91a951f173fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:35.927320 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25a3e216-a43d-4738-ab92-91a951f173fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:35.927780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25a3e216-a43d-4738-ab92-91a951f173fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:35.928582 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25a3e216-a43d-4738-ab92-91a951f173fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:35.929007 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25a3e216-a43d-4738-ab92-91a951f173fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:36.124428 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-25a3e216-a43d-4738-ab92-91a951f173fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:36.131709 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-25a3e216-a43d-4738-ab92-91a951f173fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1504 microversion: 2.1 time: 0.215922 May 17 18:26:36.132273 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 490/929] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:35 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:37.150047 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d2b7fdfa-cc65-4e34-8bd0-5b828c2baa07 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:37.150752 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d2b7fdfa-cc65-4e34-8bd0-5b828c2baa07 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:37.157432 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d2b7fdfa-cc65-4e34-8bd0-5b828c2baa07 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:37.157911 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d2b7fdfa-cc65-4e34-8bd0-5b828c2baa07 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:37.158689 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d2b7fdfa-cc65-4e34-8bd0-5b828c2baa07 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:37.159130 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d2b7fdfa-cc65-4e34-8bd0-5b828c2baa07 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:37.381484 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d2b7fdfa-cc65-4e34-8bd0-5b828c2baa07 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:37.389880 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d2b7fdfa-cc65-4e34-8bd0-5b828c2baa07 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1504 microversion: 2.1 time: 0.244040 May 17 18:26:37.390460 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 440/930] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:37 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1504 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:38.064870 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-d7f2327e-7314-4d25-9fcb-462ead38c7ca req-06f83bc3-bfd6-4ec7-8df7-4d08e25a29d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f2b9d9e-6ae9-4827-a320-80407d14dc40", "name": "network-vif-deleted", "tag": "be72679b-55e9-43c5-8e6a-262e476879da"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:38.088830 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-d7f2327e-7314-4d25-9fcb-462ead38c7ca req-06f83bc3-bfd6-4ec7-8df7-4d08e25a29d1 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:38.089624 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-d7f2327e-7314-4d25-9fcb-462ead38c7ca req-06f83bc3-bfd6-4ec7-8df7-4d08e25a29d1 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:38.108968 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-d7f2327e-7314-4d25-9fcb-462ead38c7ca req-06f83bc3-bfd6-4ec7-8df7-4d08e25a29d1 service nova] Creating event network-vif-deleted:be72679b-55e9-43c5-8e6a-262e476879da for instance 8f2b9d9e-6ae9-4827-a320-80407d14dc40 on hv-cinder-83736 May 17 18:26:38.113842 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-d7f2327e-7314-4d25-9fcb-462ead38c7ca req-06f83bc3-bfd6-4ec7-8df7-4d08e25a29d1 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052573 May 17 18:26:38.115112 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 491/931] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:38.407662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-63561017-8d9f-463b-8293-c99818ef590f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:38.408288 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-63561017-8d9f-463b-8293-c99818ef590f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:38.416120 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63561017-8d9f-463b-8293-c99818ef590f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:38.416567 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63561017-8d9f-463b-8293-c99818ef590f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:38.417349 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63561017-8d9f-463b-8293-c99818ef590f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:38.417821 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63561017-8d9f-463b-8293-c99818ef590f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:38.453504 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63561017-8d9f-463b-8293-c99818ef590f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:38.454363 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-63561017-8d9f-463b-8293-c99818ef590f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:38.454938 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-63561017-8d9f-463b-8293-c99818ef590f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lazy-loading 'fault' on Instance uuid 8f2b9d9e-6ae9-4827-a320-80407d14dc40 {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:26:38.500752 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-63561017-8d9f-463b-8293-c99818ef590f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:38.510226 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-63561017-8d9f-463b-8293-c99818ef590f tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 200 len: 1304 microversion: 2.1 time: 0.106628 May 17 18:26:38.510814 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 441/932] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:38 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:39.527742 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aa3e61bb-8ce4-4364-9514-e7c716fcd26c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:39.529181 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-aa3e61bb-8ce4-4364-9514-e7c716fcd26c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: 8f2b9d9e-6ae9-4827-a320-80407d14dc40] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:39.537356 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa3e61bb-8ce4-4364-9514-e7c716fcd26c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:39.538025 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa3e61bb-8ce4-4364-9514-e7c716fcd26c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:39.539217 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa3e61bb-8ce4-4364-9514-e7c716fcd26c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:39.539826 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aa3e61bb-8ce4-4364-9514-e7c716fcd26c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:39.563274 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-aa3e61bb-8ce4-4364-9514-e7c716fcd26c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] HTTP exception thrown: Instance 8f2b9d9e-6ae9-4827-a320-80407d14dc40 could not be found. May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aa3e61bb-8ce4-4364-9514-e7c716fcd26c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Request method failure captured: May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 HTTP/1.1 May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-jMVHdz4voB1aLell19rwESK9CE5BIJ1s9lcQvY-SEYV1IVCpNQQNFvW0NubBC6EBMZ1lsts2Jsndd1rLKyEQlG0QFko2n6IdDRhmeOCR_Q-gHsF39c6fwFuTKM9Wa5r2aLHiX-whHF2I8vrMgp1WTjrNIqe95ZBdhvoxE_P1fuVgw May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 7c88151132894c38874f6c453c9177f6 May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-VolumesActionsTest-1251343074 May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:26:39.565664 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7c88151132894c38874f6c453c9177f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7c88151132894c38874f6c453c9177f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7c88151132894c38874f6c453c9177f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7c88151132894c38874f6c453c9177f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-VolumesActionsTest-1251343074 May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 7c88151132894c38874f6c453c9177f6 May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-VolumesActionsTest-1251343074 May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-VolumesActionsTest-1251343074-project May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: edb9684cd47f46538fc4faf85bdf29fa May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-VolumesActionsTest-1251343074-project May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 8f2b9d9e-6ae9-4827-a320-80407d14dc40 could not be found. May 17 18:26:39.567675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '8f2b9d9e-6ae9-4827-a320-80407d14dc40'} May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f2b9d9e-6ae9-4827-a320-80407d14dc40 could not be found. May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:26:39.569219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f2b9d9e-6ae9-4827-a320-80407d14dc40 could not be found. May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f2b9d9e-6ae9-4827-a320-80407d14dc40 could not be found. May 17 18:26:39.570593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:26:39.571789 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aa3e61bb-8ce4-4364-9514-e7c716fcd26c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Returning 404 to user: Instance 8f2b9d9e-6ae9-4827-a320-80407d14dc40 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:26:39.571789 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-aa3e61bb-8ce4-4364-9514-e7c716fcd26c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40" status: 404 len: 111 microversion: 2.1 time: 0.043817 May 17 18:26:39.571789 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 492/933] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:39 2022] GET /compute/v2.1/servers/8f2b9d9e-6ae9-4827-a320-80407d14dc40 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:26:39.621779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1719968803", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "networks": [{"uuid": "837d8b04-5531-4d25-8d9f-1ce43ec42ea1"}]}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:39.677857 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] validate_networks() for [('837d8b04-5531-4d25-8d9f-1ce43ec42ea1', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:26:40.305952 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:26:40.306377 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:26:40.306931 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:26:40.307367 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:26:40.307781 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:26:40.317265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:40.317781 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:40.318639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:40.319083 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:40.335724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Getting quotas for project 7c88151132894c38874f6c453c9177f6. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:26:40.339671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Getting quotas for user edb9684cd47f46538fc4faf85bdf29fa and project 7c88151132894c38874f6c453c9177f6. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:26:40.350888 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:26:40.353306 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:26:40.398973 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a4524ac5-a824-4ba9-aca8-635f3ccc08fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780819 May 17 18:26:40.399622 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 442/934] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:26:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:26:40.409906 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4e25e607-3b40-4e25-9d21-5650ea42be5a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:40.410605 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4e25e607-3b40-4e25-9d21-5650ea42be5a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:40.482378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4e25e607-3b40-4e25-9d21-5650ea42be5a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:40.490174 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4e25e607-3b40-4e25-9d21-5650ea42be5a tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1214 microversion: 2.1 time: 0.083492 May 17 18:26:40.490910 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 493/935] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:40 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:41.507816 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-703244fb-f03d-45cf-8860-c6757e320244 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:41.508438 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-703244fb-f03d-45cf-8860-c6757e320244 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:41.519309 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-703244fb-f03d-45cf-8860-c6757e320244 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:41.519896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-703244fb-f03d-45cf-8860-c6757e320244 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:41.520743 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-703244fb-f03d-45cf-8860-c6757e320244 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:41.521227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-703244fb-f03d-45cf-8860-c6757e320244 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:41.869629 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-703244fb-f03d-45cf-8860-c6757e320244 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:41.878331 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-703244fb-f03d-45cf-8860-c6757e320244 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1272 microversion: 2.1 time: 0.374330 May 17 18:26:41.879587 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 443/936] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:41 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1272 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:42.736676 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-cc32e0dc-91c2-4f38-9c89-fb347f292c3e req-5bbdbdc6-534d-400d-b2d0-ef0e8e97d501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4371fce-667a-4595-9cf3-1f3829956b1d", "tag": "d5ffa1c2-5dc6-449f-ab4b-0c61ced4f85e"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:42.754380 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-cc32e0dc-91c2-4f38-9c89-fb347f292c3e req-5bbdbdc6-534d-400d-b2d0-ef0e8e97d501 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:42.754828 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-cc32e0dc-91c2-4f38-9c89-fb347f292c3e req-5bbdbdc6-534d-400d-b2d0-ef0e8e97d501 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:42.766565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-cc32e0dc-91c2-4f38-9c89-fb347f292c3e req-5bbdbdc6-534d-400d-b2d0-ef0e8e97d501 service nova] Creating event network-changed:d5ffa1c2-5dc6-449f-ab4b-0c61ced4f85e for instance c4371fce-667a-4595-9cf3-1f3829956b1d on hv-cinder-83736 May 17 18:26:42.773225 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-cc32e0dc-91c2-4f38-9c89-fb347f292c3e req-5bbdbdc6-534d-400d-b2d0-ef0e8e97d501 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044083 May 17 18:26:42.774330 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 494/937] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:42.896600 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-92f51598-1c00-4e5b-807b-07c1be5f7099 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:42.897221 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-92f51598-1c00-4e5b-807b-07c1be5f7099 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:42.907922 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-92f51598-1c00-4e5b-807b-07c1be5f7099 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:42.908379 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-92f51598-1c00-4e5b-807b-07c1be5f7099 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:42.909161 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-92f51598-1c00-4e5b-807b-07c1be5f7099 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:42.909629 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-92f51598-1c00-4e5b-807b-07c1be5f7099 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:43.142218 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-92f51598-1c00-4e5b-807b-07c1be5f7099 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:43.153079 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-92f51598-1c00-4e5b-807b-07c1be5f7099 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1314 microversion: 2.1 time: 0.260996 May 17 18:26:43.153716 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 444/938] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:42 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:44.171131 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-67d27c1d-ce3d-4fda-919a-7c1f61909889 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:44.171847 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-67d27c1d-ce3d-4fda-919a-7c1f61909889 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:44.177871 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-67d27c1d-ce3d-4fda-919a-7c1f61909889 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:44.178560 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-67d27c1d-ce3d-4fda-919a-7c1f61909889 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:44.179343 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-67d27c1d-ce3d-4fda-919a-7c1f61909889 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:44.179789 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-67d27c1d-ce3d-4fda-919a-7c1f61909889 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:44.323996 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-67d27c1d-ce3d-4fda-919a-7c1f61909889 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:44.332462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-67d27c1d-ce3d-4fda-919a-7c1f61909889 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1314 microversion: 2.1 time: 0.166012 May 17 18:26:44.333129 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 495/939] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:44 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:45.350254 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-278b821c-5b80-4102-939b-5eb1a8803e57 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:45.350904 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-278b821c-5b80-4102-939b-5eb1a8803e57 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:45.357936 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-278b821c-5b80-4102-939b-5eb1a8803e57 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:45.358398 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-278b821c-5b80-4102-939b-5eb1a8803e57 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:45.359184 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-278b821c-5b80-4102-939b-5eb1a8803e57 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:45.359628 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-278b821c-5b80-4102-939b-5eb1a8803e57 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:45.483260 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-278b821c-5b80-4102-939b-5eb1a8803e57 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:45.490488 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-278b821c-5b80-4102-939b-5eb1a8803e57 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1314 microversion: 2.1 time: 0.144108 May 17 18:26:45.491248 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 445/940] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:45 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:46.507131 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cd7551ff-4cf7-449c-9d9a-e317e4e67229 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:46.507768 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cd7551ff-4cf7-449c-9d9a-e317e4e67229 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:46.514524 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd7551ff-4cf7-449c-9d9a-e317e4e67229 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:46.514988 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd7551ff-4cf7-449c-9d9a-e317e4e67229 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:46.515765 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd7551ff-4cf7-449c-9d9a-e317e4e67229 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:46.516209 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd7551ff-4cf7-449c-9d9a-e317e4e67229 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:46.639985 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cd7551ff-4cf7-449c-9d9a-e317e4e67229 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:46.647264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cd7551ff-4cf7-449c-9d9a-e317e4e67229 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1314 microversion: 2.1 time: 0.144010 May 17 18:26:46.647820 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 496/941] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:46 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1314 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:26:47.664768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-dcab37ad-fb67-4172-91e9-0078c3dd45ca tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:47.665394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-dcab37ad-fb67-4172-91e9-0078c3dd45ca tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:47.671765 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dcab37ad-fb67-4172-91e9-0078c3dd45ca tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:47.672228 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dcab37ad-fb67-4172-91e9-0078c3dd45ca tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:47.673007 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dcab37ad-fb67-4172-91e9-0078c3dd45ca tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:47.673481 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dcab37ad-fb67-4172-91e9-0078c3dd45ca tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:47.803024 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dcab37ad-fb67-4172-91e9-0078c3dd45ca tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:47.810921 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-dcab37ad-fb67-4172-91e9-0078c3dd45ca tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1314 microversion: 2.1 time: 0.150058 May 17 18:26:47.811478 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 446/942] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:47 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:48.389367 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-28aabaa2-48e3-4ff4-a612-d06b65ab3f1a req-fddf1c96-9566-4aa3-8fa0-37386301ff32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4371fce-667a-4595-9cf3-1f3829956b1d", "name": "network-vif-plugged", "status": "completed", "tag": "d5ffa1c2-5dc6-449f-ab4b-0c61ced4f85e"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:48.397919 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-28aabaa2-48e3-4ff4-a612-d06b65ab3f1a req-fddf1c96-9566-4aa3-8fa0-37386301ff32 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:48.398375 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-28aabaa2-48e3-4ff4-a612-d06b65ab3f1a req-fddf1c96-9566-4aa3-8fa0-37386301ff32 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:48.410022 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-28aabaa2-48e3-4ff4-a612-d06b65ab3f1a req-fddf1c96-9566-4aa3-8fa0-37386301ff32 service nova] Creating event network-vif-plugged:d5ffa1c2-5dc6-449f-ab4b-0c61ced4f85e for instance c4371fce-667a-4595-9cf3-1f3829956b1d on hv-cinder-83736 May 17 18:26:48.414805 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-28aabaa2-48e3-4ff4-a612-d06b65ab3f1a req-fddf1c96-9566-4aa3-8fa0-37386301ff32 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029148 May 17 18:26:48.415398 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 497/943] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:48.828799 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ff0a9087-509d-4f8b-9903-39f46823051c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:48.829341 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ff0a9087-509d-4f8b-9903-39f46823051c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:48.836137 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ff0a9087-509d-4f8b-9903-39f46823051c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:48.836243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ff0a9087-509d-4f8b-9903-39f46823051c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:48.837021 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ff0a9087-509d-4f8b-9903-39f46823051c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:48.837484 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ff0a9087-509d-4f8b-9903-39f46823051c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:48.963403 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ff0a9087-509d-4f8b-9903-39f46823051c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:48.970687 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ff0a9087-509d-4f8b-9903-39f46823051c tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1314 microversion: 2.1 time: 0.147006 May 17 18:26:48.971247 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 447/944] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:48 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:49.989078 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-82c869ee-292a-4bb6-b40d-1b855f9607dd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:49.989766 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-82c869ee-292a-4bb6-b40d-1b855f9607dd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:49.995938 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-82c869ee-292a-4bb6-b40d-1b855f9607dd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:49.996394 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-82c869ee-292a-4bb6-b40d-1b855f9607dd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:49.997186 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-82c869ee-292a-4bb6-b40d-1b855f9607dd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:49.997669 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-82c869ee-292a-4bb6-b40d-1b855f9607dd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:50.123462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-82c869ee-292a-4bb6-b40d-1b855f9607dd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:50.130589 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-82c869ee-292a-4bb6-b40d-1b855f9607dd tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1314 microversion: 2.1 time: 0.146275 May 17 18:26:50.131149 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 498/945] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:49 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:51.147899 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5caa927a-6840-42f9-a1d7-8e59ac6e71fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:51.148518 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5caa927a-6840-42f9-a1d7-8e59ac6e71fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:51.155368 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5caa927a-6840-42f9-a1d7-8e59ac6e71fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:51.155823 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5caa927a-6840-42f9-a1d7-8e59ac6e71fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:51.156587 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5caa927a-6840-42f9-a1d7-8e59ac6e71fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:51.157029 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5caa927a-6840-42f9-a1d7-8e59ac6e71fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:51.268177 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4a05a706-7a24-406f-ae98-ee5b3d49d2d0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:51.268751 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4a05a706-7a24-406f-ae98-ee5b3d49d2d0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:51.274931 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a05a706-7a24-406f-ae98-ee5b3d49d2d0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:51.275379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a05a706-7a24-406f-ae98-ee5b3d49d2d0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:51.276142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a05a706-7a24-406f-ae98-ee5b3d49d2d0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:51.276575 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4a05a706-7a24-406f-ae98-ee5b3d49d2d0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:51.281585 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5caa927a-6840-42f9-a1d7-8e59ac6e71fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:51.288833 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5caa927a-6840-42f9-a1d7-8e59ac6e71fc tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1498 microversion: 2.1 time: 0.144824 May 17 18:26:51.289387 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 448/946] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:51 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1498 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:51.300765 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4a05a706-7a24-406f-ae98-ee5b3d49d2d0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/ips" status: 200 len: 149 microversion: 2.1 time: 0.036373 May 17 18:26:51.301320 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 499/947] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 17 18:26:51 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:26:51.821684 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-47f9eded-abbe-48d4-9709-ce647961b765 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:51.822189 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-47f9eded-abbe-48d4-9709-ce647961b765 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:51.828411 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47f9eded-abbe-48d4-9709-ce647961b765 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:51.828869 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47f9eded-abbe-48d4-9709-ce647961b765 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:51.829678 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47f9eded-abbe-48d4-9709-ce647961b765 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:51.830134 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-47f9eded-abbe-48d4-9709-ce647961b765 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:51.856915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-47f9eded-abbe-48d4-9709-ce647961b765 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:26:51.930571 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-47f9eded-abbe-48d4-9709-ce647961b765 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "DELETE /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 204 len: 0 microversion: 2.1 time: 0.112573 May 17 18:26:51.931140 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 449/948] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:26:51 2022] DELETE /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:26:51.940022 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f0664030-382e-4095-a044-07e9265284fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:51.940632 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f0664030-382e-4095-a044-07e9265284fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:51.946465 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f0664030-382e-4095-a044-07e9265284fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:51.946914 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f0664030-382e-4095-a044-07e9265284fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:51.947681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f0664030-382e-4095-a044-07e9265284fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:51.948117 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f0664030-382e-4095-a044-07e9265284fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:52.072847 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f0664030-382e-4095-a044-07e9265284fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:52.080382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f0664030-382e-4095-a044-07e9265284fb tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1504 microversion: 2.1 time: 0.144487 May 17 18:26:52.080937 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 500/949] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:51 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1504 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:52.623866 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-41175b95-86db-4979-a3eb-47804e1480c0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea634e25-d70e-45dd-9711-9aadef2a163a"}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:52.625077 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-41175b95-86db-4979-a3eb-47804e1480c0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:52.631358 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-41175b95-86db-4979-a3eb-47804e1480c0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:52.631807 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-41175b95-86db-4979-a3eb-47804e1480c0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:52.632574 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-41175b95-86db-4979-a3eb-47804e1480c0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:52.633009 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-41175b95-86db-4979-a3eb-47804e1480c0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:53.096951 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-dccffada-9aa3-4a78-a36b-2ac24a589234 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:53.097825 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-dccffada-9aa3-4a78-a36b-2ac24a589234 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:53.104538 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dccffada-9aa3-4a78-a36b-2ac24a589234 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:53.105010 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dccffada-9aa3-4a78-a36b-2ac24a589234 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:53.105811 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dccffada-9aa3-4a78-a36b-2ac24a589234 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:53.106250 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dccffada-9aa3-4a78-a36b-2ac24a589234 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:53.197914 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-41175b95-86db-4979-a3eb-47804e1480c0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.578572 May 17 18:26:53.198594 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 450/950] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:26:52 2022] POST /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-volume_attachments => generated 194 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:53.246373 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-dccffada-9aa3-4a78-a36b-2ac24a589234 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:53.254796 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-dccffada-9aa3-4a78-a36b-2ac24a589234 tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1504 microversion: 2.1 time: 0.161857 May 17 18:26:53.256043 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 501/951] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:53 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:26:54.004616 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-802fe632-34f3-431d-ab21-59b0e5c70468 req-e1630d68-434b-4271-be01-485b53f1de39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4371fce-667a-4595-9cf3-1f3829956b1d", "name": "network-vif-deleted", "tag": "d5ffa1c2-5dc6-449f-ab4b-0c61ced4f85e"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:26:54.012914 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-802fe632-34f3-431d-ab21-59b0e5c70468 req-e1630d68-434b-4271-be01-485b53f1de39 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:54.013371 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-802fe632-34f3-431d-ab21-59b0e5c70468 req-e1630d68-434b-4271-be01-485b53f1de39 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:54.026179 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-802fe632-34f3-431d-ab21-59b0e5c70468 req-e1630d68-434b-4271-be01-485b53f1de39 service nova] Creating event network-vif-deleted:d5ffa1c2-5dc6-449f-ab4b-0c61ced4f85e for instance c4371fce-667a-4595-9cf3-1f3829956b1d on hv-cinder-83736 May 17 18:26:54.032930 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-802fe632-34f3-431d-ab21-59b0e5c70468 req-e1630d68-434b-4271-be01-485b53f1de39 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032800 May 17 18:26:54.033528 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 451/952] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:26:54.271848 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f690f102-1a04-4e2e-a52b-2836f1963b8d tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:54.272462 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f690f102-1a04-4e2e-a52b-2836f1963b8d tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:54.278717 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f690f102-1a04-4e2e-a52b-2836f1963b8d tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:54.279168 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f690f102-1a04-4e2e-a52b-2836f1963b8d tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:54.279934 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f690f102-1a04-4e2e-a52b-2836f1963b8d tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:54.280372 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f690f102-1a04-4e2e-a52b-2836f1963b8d tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:54.312788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f690f102-1a04-4e2e-a52b-2836f1963b8d tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:54.313237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f690f102-1a04-4e2e-a52b-2836f1963b8d tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:54.313710 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-f690f102-1a04-4e2e-a52b-2836f1963b8d tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lazy-loading 'fault' on Instance uuid c4371fce-667a-4595-9cf3-1f3829956b1d {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:26:54.356848 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f690f102-1a04-4e2e-a52b-2836f1963b8d tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb9684cd47f46538fc4faf85bdf29fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c88151132894c38874f6c453c9177f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:26:54.364547 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f690f102-1a04-4e2e-a52b-2836f1963b8d tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 200 len: 1304 microversion: 2.1 time: 0.096486 May 17 18:26:54.365096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 502/953] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:54 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:26:55.382478 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-949e0b03-a960-4478-b066-2bde311b9f3b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:26:55.383184 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-949e0b03-a960-4478-b066-2bde311b9f3b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] [instance: c4371fce-667a-4595-9cf3-1f3829956b1d] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:26:55.389737 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-949e0b03-a960-4478-b066-2bde311b9f3b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:55.390194 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-949e0b03-a960-4478-b066-2bde311b9f3b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:55.390961 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-949e0b03-a960-4478-b066-2bde311b9f3b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:26:55.391407 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-949e0b03-a960-4478-b066-2bde311b9f3b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:26:55.404149 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-949e0b03-a960-4478-b066-2bde311b9f3b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] HTTP exception thrown: Instance c4371fce-667a-4595-9cf3-1f3829956b1d could not be found. May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-949e0b03-a960-4478-b066-2bde311b9f3b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Request method failure captured: May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d HTTP/1.1 May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-jMVHdz4voB1aLell19rwESK9CE5BIJ1s9lcQvY-SEYV1IVCpNQQNFvW0NubBC6EBMZ1lsts2Jsndd1rLKyEQlG0QFko2n6IdDRhmeOCR_Q-gHsF39c6fwFuTKM9Wa5r2aLHiX-whHF2I8vrMgp1WTjrNIqe95ZBdhvoxE_P1fuVgw May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 7c88151132894c38874f6c453c9177f6 May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-VolumesActionsTest-1251343074 May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:26:55.406338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_7c88151132894c38874f6c453c9177f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7c88151132894c38874f6c453c9177f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/7c88151132894c38874f6c453c9177f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/7c88151132894c38874f6c453c9177f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-VolumesActionsTest-1251343074 May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 7c88151132894c38874f6c453c9177f6 May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-VolumesActionsTest-1251343074 May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-VolumesActionsTest-1251343074-project May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: edb9684cd47f46538fc4faf85bdf29fa May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-VolumesActionsTest-1251343074-project May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance c4371fce-667a-4595-9cf3-1f3829956b1d could not be found. May 17 18:26:55.408001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': 'c4371fce-667a-4595-9cf3-1f3829956b1d'} May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4371fce-667a-4595-9cf3-1f3829956b1d could not be found. May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:26:55.409044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4371fce-667a-4595-9cf3-1f3829956b1d could not be found. May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4371fce-667a-4595-9cf3-1f3829956b1d could not be found. May 17 18:26:55.410682 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:26:55.412075 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-949e0b03-a960-4478-b066-2bde311b9f3b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] Returning 404 to user: Instance c4371fce-667a-4595-9cf3-1f3829956b1d could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:26:55.412075 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-949e0b03-a960-4478-b066-2bde311b9f3b tempest-VolumesActionsTest-1251343074 tempest-VolumesActionsTest-1251343074-project] 10.222.0.65 "GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d" status: 404 len: 111 microversion: 2.1 time: 0.029554 May 17 18:26:55.412075 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 452/954] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:26:55 2022] GET /compute/v2.1/servers/c4371fce-667a-4595-9cf3-1f3829956b1d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:27:01.741413 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-74671543-548d-41b1-bdb6-0c3f9d448bb8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea634e25-d70e-45dd-9711-9aadef2a163a"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:01.743746 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-74671543-548d-41b1-bdb6-0c3f9d448bb8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:01.756280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-74671543-548d-41b1-bdb6-0c3f9d448bb8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:01.757140 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-74671543-548d-41b1-bdb6-0c3f9d448bb8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:01.758387 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-74671543-548d-41b1-bdb6-0c3f9d448bb8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:01.758883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-74671543-548d-41b1-bdb6-0c3f9d448bb8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:01.854204 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-74671543-548d-41b1-bdb6-0c3f9d448bb8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Invalid volume: volume ea634e25-d70e-45dd-9711-9aadef2a163a is already attached to instances: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-74671543-548d-41b1-bdb6-0c3f9d448bb8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: POST /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-volume_attachments HTTP/1.1 May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 74 May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:27:01.856425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {"volumeAttachment": {"volumeId": "ea634e25-d70e-45dd-9711-9aadef2a163a"}} May 17 18:27:01.857862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Invalid volume: volume ea634e25-d70e-45dd-9711-9aadef2a163a is already attached to instances: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'server_id': '4d5daec8-cf69-4eba-b4e1-6ded1a8cec02', 'body': {'volumeAttachment': {'volumeId': 'ea634e25-d70e-45dd-9711-9aadef2a163a'}}} May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ea634e25-d70e-45dd-9711-9aadef2a163a is already attached to instances: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:01.861861 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ea634e25-d70e-45dd-9711-9aadef2a163a is already attached to instances: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:01.863119 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:01.864326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:01.864326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:27:01.864326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:27:01.864326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ea634e25-d70e-45dd-9711-9aadef2a163a is already attached to instances: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 May 17 18:27:01.864326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:01.864326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-74671543-548d-41b1-bdb6-0c3f9d448bb8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 400 to user: Invalid volume: volume ea634e25-d70e-45dd-9711-9aadef2a163a is already attached to instances: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:27:01.864326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-74671543-548d-41b1-bdb6-0c3f9d448bb8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.123345 May 17 18:27:01.864326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 503/955] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:27:01 2022] POST /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-volume_attachments => generated 174 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 17 18:27:01.934085 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-95fb6cfc-4d48-411b-9225-36b855c5637f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:01.934648 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-95fb6cfc-4d48-411b-9225-36b855c5637f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:01.941529 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-95fb6cfc-4d48-411b-9225-36b855c5637f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:01.941986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-95fb6cfc-4d48-411b-9225-36b855c5637f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:01.942954 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-95fb6cfc-4d48-411b-9225-36b855c5637f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:01.943401 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-95fb6cfc-4d48-411b-9225-36b855c5637f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:02.032338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-95fb6cfc-4d48-411b-9225-36b855c5637f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lazy-loading 'services' on Instance uuid 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:27:02.109269 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-95fb6cfc-4d48-411b-9225-36b855c5637f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-volume_attachments/ea634e25-d70e-45dd-9711-9aadef2a163a" status: 202 len: 0 microversion: 2.1 time: 0.179076 May 17 18:27:02.113310 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 453/956] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:27:01 2022] DELETE /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-volume_attachments/ea634e25-d70e-45dd-9711-9aadef2a163a => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:27:02.120185 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a9a89357-7ddc-4faa-b3e7-89b68bd622d7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:02.121529 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a9a89357-7ddc-4faa-b3e7-89b68bd622d7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:02.130391 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a9a89357-7ddc-4faa-b3e7-89b68bd622d7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:02.130952 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a9a89357-7ddc-4faa-b3e7-89b68bd622d7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:02.131770 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a9a89357-7ddc-4faa-b3e7-89b68bd622d7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:02.132388 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a9a89357-7ddc-4faa-b3e7-89b68bd622d7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:02.174280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a9a89357-7ddc-4faa-b3e7-89b68bd622d7 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059333 May 17 18:27:02.175012 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 504/957] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:27:02 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:03.190134 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-36dc485d-50ed-47e6-8d4b-f0f22c72198d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:03.195658 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-36dc485d-50ed-47e6-8d4b-f0f22c72198d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:03.205639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-36dc485d-50ed-47e6-8d4b-f0f22c72198d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:03.206096 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-36dc485d-50ed-47e6-8d4b-f0f22c72198d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:03.207111 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-36dc485d-50ed-47e6-8d4b-f0f22c72198d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:03.207975 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-36dc485d-50ed-47e6-8d4b-f0f22c72198d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:03.242415 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-36dc485d-50ed-47e6-8d4b-f0f22c72198d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060064 May 17 18:27:03.244305 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 454/958] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:27:03 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:27:03.310248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d31e7b46-6ba3-4036-ab3b-d7482961b5c5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:03.310781 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d31e7b46-6ba3-4036-ab3b-d7482961b5c5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:03.317985 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d31e7b46-6ba3-4036-ab3b-d7482961b5c5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:03.318640 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d31e7b46-6ba3-4036-ab3b-d7482961b5c5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:03.319569 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d31e7b46-6ba3-4036-ab3b-d7482961b5c5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:03.320179 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d31e7b46-6ba3-4036-ab3b-d7482961b5c5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:03.347581 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d31e7b46-6ba3-4036-ab3b-d7482961b5c5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Going to try to terminate instance {{(pid=117098) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:27:03.432131 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d31e7b46-6ba3-4036-ab3b-d7482961b5c5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 204 len: 0 microversion: 2.1 time: 0.125284 May 17 18:27:03.433869 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 505/959] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:27:03 2022] DELETE /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:27:03.442189 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e506967f-f681-4984-a0fb-3542ff770b12 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:03.443216 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e506967f-f681-4984-a0fb-3542ff770b12 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:03.449790 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e506967f-f681-4984-a0fb-3542ff770b12 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:03.450785 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e506967f-f681-4984-a0fb-3542ff770b12 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:03.451819 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e506967f-f681-4984-a0fb-3542ff770b12 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:03.452581 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e506967f-f681-4984-a0fb-3542ff770b12 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:03.598259 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e506967f-f681-4984-a0fb-3542ff770b12 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:03.606440 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e506967f-f681-4984-a0fb-3542ff770b12 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1679 microversion: 2.1 time: 0.168038 May 17 18:27:03.616399 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 455/960] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:03 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:04.625935 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5334128a-4562-4c9e-960a-92dcd0f04b42 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:04.626594 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5334128a-4562-4c9e-960a-92dcd0f04b42 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:04.633978 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5334128a-4562-4c9e-960a-92dcd0f04b42 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:04.634749 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5334128a-4562-4c9e-960a-92dcd0f04b42 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:04.636120 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5334128a-4562-4c9e-960a-92dcd0f04b42 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:04.636757 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5334128a-4562-4c9e-960a-92dcd0f04b42 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:04.775307 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5334128a-4562-4c9e-960a-92dcd0f04b42 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:04.783851 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5334128a-4562-4c9e-960a-92dcd0f04b42 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1679 microversion: 2.1 time: 0.163604 May 17 18:27:04.784450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 506/961] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:04 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:05.803840 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0a9afbcd-0b2d-43c5-9b6f-3db6aab5848f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:05.805068 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0a9afbcd-0b2d-43c5-9b6f-3db6aab5848f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:05.817901 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0a9afbcd-0b2d-43c5-9b6f-3db6aab5848f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:05.822656 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0a9afbcd-0b2d-43c5-9b6f-3db6aab5848f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:05.823650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0a9afbcd-0b2d-43c5-9b6f-3db6aab5848f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:05.824383 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0a9afbcd-0b2d-43c5-9b6f-3db6aab5848f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:05.996998 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0a9afbcd-0b2d-43c5-9b6f-3db6aab5848f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:06.005892 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0a9afbcd-0b2d-43c5-9b6f-3db6aab5848f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1679 microversion: 2.1 time: 0.206517 May 17 18:27:06.006599 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 456/962] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:05 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1679 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:06.560825 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-5193299c-b174-42f9-b31b-6187894cce39 req-76f47e9a-b8c9-49d5-b29c-f7f20d286458 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5daec8-cf69-4eba-b4e1-6ded1a8cec02", "name": "network-vif-deleted", "tag": "e1f657e8-cda2-47ce-8831-b51d319d4c42"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:06.579228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-5193299c-b174-42f9-b31b-6187894cce39 req-76f47e9a-b8c9-49d5-b29c-f7f20d286458 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:06.579694 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-5193299c-b174-42f9-b31b-6187894cce39 req-76f47e9a-b8c9-49d5-b29c-f7f20d286458 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:06.603775 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-5193299c-b174-42f9-b31b-6187894cce39 req-76f47e9a-b8c9-49d5-b29c-f7f20d286458 service nova] Creating event network-vif-deleted:e1f657e8-cda2-47ce-8831-b51d319d4c42 for instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 on hv-cinder-83736 May 17 18:27:06.610030 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-5193299c-b174-42f9-b31b-6187894cce39 req-76f47e9a-b8c9-49d5-b29c-f7f20d286458 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052961 May 17 18:27:06.611526 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 507/963] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:07.022856 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7b95d36c-65ea-41e2-ba05-ec8ba0e8bf03 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:07.023487 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7b95d36c-65ea-41e2-ba05-ec8ba0e8bf03 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:07.029831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b95d36c-65ea-41e2-ba05-ec8ba0e8bf03 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:07.030295 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b95d36c-65ea-41e2-ba05-ec8ba0e8bf03 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:07.031078 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b95d36c-65ea-41e2-ba05-ec8ba0e8bf03 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:07.031528 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7b95d36c-65ea-41e2-ba05-ec8ba0e8bf03 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:07.095525 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7b95d36c-65ea-41e2-ba05-ec8ba0e8bf03 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:07.102973 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7b95d36c-65ea-41e2-ba05-ec8ba0e8bf03 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1612 microversion: 2.1 time: 0.083992 May 17 18:27:07.103547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 457/964] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:07 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1612 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:07.674719 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-017bd86a-ad65-430b-b0bb-c9417b891d5b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:07.675292 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-017bd86a-ad65-430b-b0bb-c9417b891d5b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:07.681880 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-017bd86a-ad65-430b-b0bb-c9417b891d5b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:07.682346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-017bd86a-ad65-430b-b0bb-c9417b891d5b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:07.683110 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-017bd86a-ad65-430b-b0bb-c9417b891d5b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:07.683544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-017bd86a-ad65-430b-b0bb-c9417b891d5b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:07.709382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-017bd86a-ad65-430b-b0bb-c9417b891d5b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/ips" status: 200 len: 153 microversion: 2.20 time: 0.038929 May 17 18:27:07.709973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 508/965] 10.222.0.65 () {60 vars in 1288 bytes} [Tue May 17 18:27:07 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/ips => generated 153 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 17 18:27:08.120080 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2bbaa91d-3ff6-4e14-8c4b-15e6c902d0b8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:08.120654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2bbaa91d-3ff6-4e14-8c4b-15e6c902d0b8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:08.129534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2bbaa91d-3ff6-4e14-8c4b-15e6c902d0b8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:08.129987 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2bbaa91d-3ff6-4e14-8c4b-15e6c902d0b8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:08.130764 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2bbaa91d-3ff6-4e14-8c4b-15e6c902d0b8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:08.131203 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2bbaa91d-3ff6-4e14-8c4b-15e6c902d0b8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:08.190710 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2bbaa91d-3ff6-4e14-8c4b-15e6c902d0b8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:08.198177 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2bbaa91d-3ff6-4e14-8c4b-15e6c902d0b8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1325 microversion: 2.1 time: 0.082076 May 17 18:27:08.198723 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 458/966] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:08 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1325 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:09.215517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e8c80fee-c0b5-4261-8ec9-924513a79d35 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:09.216160 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e8c80fee-c0b5-4261-8ec9-924513a79d35 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:09.222891 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e8c80fee-c0b5-4261-8ec9-924513a79d35 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:09.223338 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e8c80fee-c0b5-4261-8ec9-924513a79d35 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:09.224097 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e8c80fee-c0b5-4261-8ec9-924513a79d35 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:09.224530 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e8c80fee-c0b5-4261-8ec9-924513a79d35 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:09.254767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e8c80fee-c0b5-4261-8ec9-924513a79d35 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:09.255215 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e8c80fee-c0b5-4261-8ec9-924513a79d35 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:09.255681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-e8c80fee-c0b5-4261-8ec9-924513a79d35 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lazy-loading 'fault' on Instance uuid 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:27:09.296237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e8c80fee-c0b5-4261-8ec9-924513a79d35 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:09.304133 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e8c80fee-c0b5-4261-8ec9-924513a79d35 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1330 microversion: 2.1 time: 0.092460 May 17 18:27:09.304680 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 509/967] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:09 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:10.320967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-bf70e4dc-898b-42e9-9473-b8cd1577c3b5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:10.321623 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-bf70e4dc-898b-42e9-9473-b8cd1577c3b5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:10.328242 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bf70e4dc-898b-42e9-9473-b8cd1577c3b5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:10.328695 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bf70e4dc-898b-42e9-9473-b8cd1577c3b5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:10.329532 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bf70e4dc-898b-42e9-9473-b8cd1577c3b5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:10.329912 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bf70e4dc-898b-42e9-9473-b8cd1577c3b5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:10.360068 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bf70e4dc-898b-42e9-9473-b8cd1577c3b5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:10.360518 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bf70e4dc-898b-42e9-9473-b8cd1577c3b5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:10.360961 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-bf70e4dc-898b-42e9-9473-b8cd1577c3b5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lazy-loading 'fault' on Instance uuid 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:27:10.400859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bf70e4dc-898b-42e9-9473-b8cd1577c3b5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:10.408154 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-bf70e4dc-898b-42e9-9473-b8cd1577c3b5 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 200 len: 1330 microversion: 2.1 time: 0.091148 May 17 18:27:10.408726 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 459/968] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:10 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 1330 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:11.425853 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-54d564a7-c5fb-4574-a05b-02ff113e9496 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:11.427176 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-54d564a7-c5fb-4574-a05b-02ff113e9496 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:11.434789 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-54d564a7-c5fb-4574-a05b-02ff113e9496 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:11.435698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-54d564a7-c5fb-4574-a05b-02ff113e9496 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:11.438133 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-54d564a7-c5fb-4574-a05b-02ff113e9496 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:11.438916 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-54d564a7-c5fb-4574-a05b-02ff113e9496 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:11.456157 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-54d564a7-c5fb-4574-a05b-02ff113e9496 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-54d564a7-c5fb-4574-a05b-02ff113e9496 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 HTTP/1.1 May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:27:11.457798 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:27:11.459305 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '4d5daec8-cf69-4eba-b4e1-6ded1a8cec02'} May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:27:11.460031 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:27:11.461300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:11.463873 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-54d564a7-c5fb-4574-a05b-02ff113e9496 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:27:11.464805 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-54d564a7-c5fb-4574-a05b-02ff113e9496 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 404 len: 111 microversion: 2.1 time: 0.043562 May 17 18:27:11.468975 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 510/969] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:11 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:27:11.474899 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-cb6f4017-8f1b-4663-bccd-92ad25d7fa63 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '.version_select at 0x7f4e602569d0>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:11.499454 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-cb6f4017-8f1b-4663-bccd-92ad25d7fa63 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-661996070" status: 202 len: 0 microversion: 2.1 time: 0.028876 May 17 18:27:11.500562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 460/970] 10.222.0.65 () {58 vars in 1217 bytes} [Tue May 17 18:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-661996070 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:27:12.585137 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-dde3700d-c520-4ff5-9450-cb9886f1754e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: .version_select at 0x7f4e5b2ee940>, body: {"keypair": {"name": "tempest-keypair-424586479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJlsrSQvlCaHc+meuF890ESQ3tigAUcre37SKT/0FvP9l9tHkxNbsDtELRDHBIIVE6u+En5hvYatVIvb4H6zoat8fPWp1rqaSAY+viif29n7QiyCqR4t22rgtp1BhIdqEA=="}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:12.600552 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-dde3700d-c520-4ff5-9450-cb9886f1754e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:27:12.604569 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.quota [None req-dde3700d-c520-4ff5-9450-cb9886f1754e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for user 13b4ec46d3cb49faba3f063dcfd644c3 and project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'key_pairs'} {{(pid=117098) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:27:12.628763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-dde3700d-c520-4ff5-9450-cb9886f1754e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047549 May 17 18:27:12.633598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 511/971] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 17 18:27:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:12.808029 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-fcd9fbff-ebf3-44cf-9669-49c4634c4544 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:12.813586 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-fcd9fbff-ebf3-44cf-9669-49c4634c4544 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:12.829498 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fcd9fbff-ebf3-44cf-9669-49c4634c4544 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:12.838503 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fcd9fbff-ebf3-44cf-9669-49c4634c4544 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:12.839929 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fcd9fbff-ebf3-44cf-9669-49c4634c4544 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:12.840601 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fcd9fbff-ebf3-44cf-9669-49c4634c4544 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:12.878019 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-fcd9fbff-ebf3-44cf-9669-49c4634c4544 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lazy-loading 'flavor' on Instance uuid 54d4de87-f1c0-4e32-9c17-09a87a23dc55 {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:27:13.202608 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-fcd9fbff-ebf3-44cf-9669-49c4634c4544 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "POST /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/action" status: 202 len: 0 microversion: 2.20 time: 0.409842 May 17 18:27:13.212507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0669b0b5-4b18-49f8-affd-e88b03455891 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:13.213701 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0669b0b5-4b18-49f8-affd-e88b03455891 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:13.224187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 461/972] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 17 18:27:12 2022] POST /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/action => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 18:27:13.229255 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0669b0b5-4b18-49f8-affd-e88b03455891 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:13.229764 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0669b0b5-4b18-49f8-affd-e88b03455891 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:13.231401 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0669b0b5-4b18-49f8-affd-e88b03455891 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:13.231896 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0669b0b5-4b18-49f8-affd-e88b03455891 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:13.386165 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0669b0b5-4b18-49f8-affd-e88b03455891 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:13.394762 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0669b0b5-4b18-49f8-affd-e88b03455891 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:13.396788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0669b0b5-4b18-49f8-affd-e88b03455891 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:13.398382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0669b0b5-4b18-49f8-affd-e88b03455891 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.190922 May 17 18:27:13.399272 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 512/973] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:13 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:27:14.161241 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-338292405", "imageRef": "001f6fcc-e59b-4560-be3c-e457209f562c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3bbec44d-dbfb-4f33-a578-9ea7e3744727"}], "security_groups": [{"name": "tempest-securitygroup--718532045"}], "key_name": "tempest-keypair-424586479", "user_data": "}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:14.274218 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] validate_networks() for [('3bbec44d-dbfb-4f33-a578-9ea7e3744727', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:27:14.418422 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c9f8b811-cfc7-4a06-9dae-5bbb1a568df1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:14.419075 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c9f8b811-cfc7-4a06-9dae-5bbb1a568df1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:14.426312 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c9f8b811-cfc7-4a06-9dae-5bbb1a568df1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:14.427469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c9f8b811-cfc7-4a06-9dae-5bbb1a568df1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:14.428537 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c9f8b811-cfc7-4a06-9dae-5bbb1a568df1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:14.429261 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c9f8b811-cfc7-4a06-9dae-5bbb1a568df1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:14.676299 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c9f8b811-cfc7-4a06-9dae-5bbb1a568df1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:14.689695 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c9f8b811-cfc7-4a06-9dae-5bbb1a568df1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:14.691772 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c9f8b811-cfc7-4a06-9dae-5bbb1a568df1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:14.693219 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c9f8b811-cfc7-4a06-9dae-5bbb1a568df1 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.279776 May 17 18:27:14.703297 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 513/974] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:14 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:27:14.796789 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:27:14.797959 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:27:14.798768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:27:14.799498 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:27:14.800136 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:27:14.811521 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:14.811976 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:14.813566 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:14.814045 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:14.832687 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:27:14.836792 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Getting quotas for user 13b4ec46d3cb49faba3f063dcfd644c3 and project 37a912f3b6fa407bb4495fb6462250e8. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:27:14.850552 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:27:14.852953 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='001f6fcc-e59b-4560-be3c-e457209f562c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:27:14.906524 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-88f59387-bac8-4a73-9481-f4d5a9a6377c tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.751409 May 17 18:27:14.910875 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 462/975] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:27:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 17 18:27:14.917163 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cac0bb0c-faf1-44ab-b588-ef79531af796 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:14.917815 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cac0bb0c-faf1-44ab-b588-ef79531af796 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:14.974788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cac0bb0c-faf1-44ab-b588-ef79531af796 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:14.982318 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cac0bb0c-faf1-44ab-b588-ef79531af796 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1240 microversion: 2.1 time: 0.068865 May 17 18:27:14.982883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 514/976] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:14 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1240 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:15.713007 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-307bbee1-37a2-4317-b32c-528aad1f577c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:15.713595 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-307bbee1-37a2-4317-b32c-528aad1f577c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:15.725712 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-307bbee1-37a2-4317-b32c-528aad1f577c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:15.726169 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-307bbee1-37a2-4317-b32c-528aad1f577c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:15.727168 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-307bbee1-37a2-4317-b32c-528aad1f577c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:15.727786 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-307bbee1-37a2-4317-b32c-528aad1f577c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:15.886937 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-307bbee1-37a2-4317-b32c-528aad1f577c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:15.896706 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-307bbee1-37a2-4317-b32c-528aad1f577c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:15.899146 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-307bbee1-37a2-4317-b32c-528aad1f577c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:15.900638 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-307bbee1-37a2-4317-b32c-528aad1f577c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.192321 May 17 18:27:15.912309 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 463/977] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:15 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:16.002804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e5e59452-05dd-4b7c-b1c0-4515ea81e41a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:16.004157 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e5e59452-05dd-4b7c-b1c0-4515ea81e41a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:16.011811 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e5e59452-05dd-4b7c-b1c0-4515ea81e41a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:16.012638 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e5e59452-05dd-4b7c-b1c0-4515ea81e41a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:16.014609 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e5e59452-05dd-4b7c-b1c0-4515ea81e41a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:16.015290 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e5e59452-05dd-4b7c-b1c0-4515ea81e41a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:16.113617 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e5e59452-05dd-4b7c-b1c0-4515ea81e41a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:16.127009 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e5e59452-05dd-4b7c-b1c0-4515ea81e41a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1300 microversion: 2.1 time: 0.129570 May 17 18:27:16.133559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 515/978] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:15 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:16.919943 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ccd95aaf-0af7-41cf-ba73-98b1fe58f99d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:16.920566 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ccd95aaf-0af7-41cf-ba73-98b1fe58f99d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:16.939373 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ccd95aaf-0af7-41cf-ba73-98b1fe58f99d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:16.939826 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ccd95aaf-0af7-41cf-ba73-98b1fe58f99d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:16.940636 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ccd95aaf-0af7-41cf-ba73-98b1fe58f99d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:16.941077 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ccd95aaf-0af7-41cf-ba73-98b1fe58f99d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:17.107591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ccd95aaf-0af7-41cf-ba73-98b1fe58f99d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:17.116778 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ccd95aaf-0af7-41cf-ba73-98b1fe58f99d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:17.123533 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ccd95aaf-0af7-41cf-ba73-98b1fe58f99d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:17.126846 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ccd95aaf-0af7-41cf-ba73-98b1fe58f99d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.211057 May 17 18:27:17.131172 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 464/979] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:16 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:17.148872 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0eaaf626-2ed0-4b09-8a74-70aaeeb92e55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:17.150081 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0eaaf626-2ed0-4b09-8a74-70aaeeb92e55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:17.163863 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0eaaf626-2ed0-4b09-8a74-70aaeeb92e55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:17.164320 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0eaaf626-2ed0-4b09-8a74-70aaeeb92e55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:17.165106 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0eaaf626-2ed0-4b09-8a74-70aaeeb92e55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:17.165806 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0eaaf626-2ed0-4b09-8a74-70aaeeb92e55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:17.311198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0eaaf626-2ed0-4b09-8a74-70aaeeb92e55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:17.320838 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0eaaf626-2ed0-4b09-8a74-70aaeeb92e55 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1365 microversion: 2.1 time: 0.175920 May 17 18:27:17.322737 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 516/980] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:17 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:17.750936 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-2ce3b880-d379-41da-83c9-7c72fb62a328 req-6a382fbb-6d2d-4b2a-81ec-a58d5349d02d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c9a311-51ca-496a-8f5b-48a1815795f5", "tag": "645fe4e9-8733-46d7-af17-34167be8896b"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:17.775204 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-2ce3b880-d379-41da-83c9-7c72fb62a328 req-6a382fbb-6d2d-4b2a-81ec-a58d5349d02d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:17.775698 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-2ce3b880-d379-41da-83c9-7c72fb62a328 req-6a382fbb-6d2d-4b2a-81ec-a58d5349d02d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:17.807360 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-2ce3b880-d379-41da-83c9-7c72fb62a328 req-6a382fbb-6d2d-4b2a-81ec-a58d5349d02d service nova] Creating event network-changed:645fe4e9-8733-46d7-af17-34167be8896b for instance 26c9a311-51ca-496a-8f5b-48a1815795f5 on hv-cinder-83736 May 17 18:27:17.817273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-2ce3b880-d379-41da-83c9-7c72fb62a328 req-6a382fbb-6d2d-4b2a-81ec-a58d5349d02d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070403 May 17 18:27:17.818466 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 465/981] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:27:18.149052 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-bf100623-68ee-42a3-b88f-cc638ca18d87 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:18.149775 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-bf100623-68ee-42a3-b88f-cc638ca18d87 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:18.156332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bf100623-68ee-42a3-b88f-cc638ca18d87 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:18.156888 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bf100623-68ee-42a3-b88f-cc638ca18d87 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:18.157949 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bf100623-68ee-42a3-b88f-cc638ca18d87 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:18.158610 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bf100623-68ee-42a3-b88f-cc638ca18d87 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:18.340434 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8ec1201d-33e9-43e2-a0b3-3cc983b851b0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:18.341907 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8ec1201d-33e9-43e2-a0b3-3cc983b851b0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:18.354495 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ec1201d-33e9-43e2-a0b3-3cc983b851b0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:18.355589 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ec1201d-33e9-43e2-a0b3-3cc983b851b0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:18.356404 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ec1201d-33e9-43e2-a0b3-3cc983b851b0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:18.357027 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8ec1201d-33e9-43e2-a0b3-3cc983b851b0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:18.363625 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-bf100623-68ee-42a3-b88f-cc638ca18d87 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:18.372459 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-bf100623-68ee-42a3-b88f-cc638ca18d87 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:18.374020 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-bf100623-68ee-42a3-b88f-cc638ca18d87 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:18.377160 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-bf100623-68ee-42a3-b88f-cc638ca18d87 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.232526 May 17 18:27:18.388161 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 517/982] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:18 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:18.517569 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8ec1201d-33e9-43e2-a0b3-3cc983b851b0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:18.525982 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8ec1201d-33e9-43e2-a0b3-3cc983b851b0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1365 microversion: 2.1 time: 0.190280 May 17 18:27:18.527351 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 466/983] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:18 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1365 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:18.909414 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-93107076-74ab-4c1c-a3d6-74236e115655 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:18.909932 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-93107076-74ab-4c1c-a3d6-74236e115655 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:18.926008 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-93107076-74ab-4c1c-a3d6-74236e115655 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:18.926718 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-93107076-74ab-4c1c-a3d6-74236e115655 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:18.927681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-93107076-74ab-4c1c-a3d6-74236e115655 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:18.928278 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-93107076-74ab-4c1c-a3d6-74236e115655 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:18.965527 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-93107076-74ab-4c1c-a3d6-74236e115655 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/ips" status: 200 len: 145 microversion: 2.1 time: 0.060182 May 17 18:27:18.968509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 518/984] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 17 18:27:18 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/ips => generated 145 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:19.101770 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2069595900", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-63217234", "security_groups": [{"name": "tempest-secgroup-smoke-1126375773"}], "block_device_mapping_v2": [{"uuid": "fadcc712-bcfc-4dda-9bb3-b701c2941954", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "38c10630-122b-4079-98b2-93ad2511bb9a"}]}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:19.259389 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] validate_networks() for [('38c10630-122b-4079-98b2-93ad2511bb9a', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:27:19.396063 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0ad22feb-f005-4540-9fe4-64dbf3a80f00 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:19.397836 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0ad22feb-f005-4540-9fe4-64dbf3a80f00 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:19.404387 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0ad22feb-f005-4540-9fe4-64dbf3a80f00 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:19.405112 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0ad22feb-f005-4540-9fe4-64dbf3a80f00 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:19.406781 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0ad22feb-f005-4540-9fe4-64dbf3a80f00 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:19.407224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0ad22feb-f005-4540-9fe4-64dbf3a80f00 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:19.641801 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0ad22feb-f005-4540-9fe4-64dbf3a80f00 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:19.664679 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0ad22feb-f005-4540-9fe4-64dbf3a80f00 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:19.676753 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0ad22feb-f005-4540-9fe4-64dbf3a80f00 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:19.679913 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0ad22feb-f005-4540-9fe4-64dbf3a80f00 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.288380 May 17 18:27:19.680568 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 519/985] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:19 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:27:19.701825 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f98a8f5e-69fb-40d8-95e3-b55c654c60bf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:19.702848 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f98a8f5e-69fb-40d8-95e3-b55c654c60bf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:19.712553 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f98a8f5e-69fb-40d8-95e3-b55c654c60bf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:19.713133 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f98a8f5e-69fb-40d8-95e3-b55c654c60bf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:19.714088 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f98a8f5e-69fb-40d8-95e3-b55c654c60bf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:19.717504 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f98a8f5e-69fb-40d8-95e3-b55c654c60bf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:19.806757 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:27:19.807302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:27:19.807664 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:27:19.808085 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:27:19.808509 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:27:19.826895 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:19.827701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:19.828983 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:19.829410 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:19.859151 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Getting quotas for project 481c26193c6141588dd15fd5c593de86. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:27:19.865639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Getting quotas for user 861ad9a7c63a4d66a1806c4576cddce5 and project 481c26193c6141588dd15fd5c593de86. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:27:19.895451 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f98a8f5e-69fb-40d8-95e3-b55c654c60bf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:19.904744 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f98a8f5e-69fb-40d8-95e3-b55c654c60bf tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1365 microversion: 2.1 time: 0.221488 May 17 18:27:19.904744 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 520/986] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:19 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1365 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:19.933263 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:27:19.935611 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fadcc712-bcfc-4dda-9bb3-b701c2941954',volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:27:20.078925 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-81d24e63-90fc-4cc3-87ec-2da92dbe0698 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.982030 May 17 18:27:20.079879 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 467/987] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:27:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:27:20.092212 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2b92818c-672f-45b8-afc3-76ebb208c1c7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:20.093228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2b92818c-672f-45b8-afc3-76ebb208c1c7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:20.154700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2b92818c-672f-45b8-afc3-76ebb208c1c7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:20.163374 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2b92818c-672f-45b8-afc3-76ebb208c1c7 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1093 microversion: 2.1 time: 0.077211 May 17 18:27:20.164458 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 521/988] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:20 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1093 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:20.398316 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-62229e56-3f9a-401c-9bc9-06723ed6edd4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "088fbd39-e429-4765-9316-19e1af0a148b"}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:20.399378 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-62229e56-3f9a-401c-9bc9-06723ed6edd4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:20.408374 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-62229e56-3f9a-401c-9bc9-06723ed6edd4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:20.409141 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-62229e56-3f9a-401c-9bc9-06723ed6edd4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:20.410475 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-62229e56-3f9a-401c-9bc9-06723ed6edd4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:20.411147 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-62229e56-3f9a-401c-9bc9-06723ed6edd4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:20.701887 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-276322ca-9216-4d65-9e23-45f5b1f0c46e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:20.702544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-276322ca-9216-4d65-9e23-45f5b1f0c46e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:20.713734 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-276322ca-9216-4d65-9e23-45f5b1f0c46e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:20.714378 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-276322ca-9216-4d65-9e23-45f5b1f0c46e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:20.715242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-276322ca-9216-4d65-9e23-45f5b1f0c46e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:20.715783 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-276322ca-9216-4d65-9e23-45f5b1f0c46e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:20.857059 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-276322ca-9216-4d65-9e23-45f5b1f0c46e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:20.865692 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-276322ca-9216-4d65-9e23-45f5b1f0c46e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:20.867226 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-276322ca-9216-4d65-9e23-45f5b1f0c46e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:20.868384 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-276322ca-9216-4d65-9e23-45f5b1f0c46e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.171418 May 17 18:27:20.868916 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 522/989] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:20 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:27:20.924949 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-fefaf829-5f4c-4057-a231-bf96af6082f8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:20.925596 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-fefaf829-5f4c-4057-a231-bf96af6082f8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:20.931541 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fefaf829-5f4c-4057-a231-bf96af6082f8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:20.931994 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fefaf829-5f4c-4057-a231-bf96af6082f8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:20.932768 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fefaf829-5f4c-4057-a231-bf96af6082f8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:20.933206 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-fefaf829-5f4c-4057-a231-bf96af6082f8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:21.064534 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-fefaf829-5f4c-4057-a231-bf96af6082f8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:21.073261 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-fefaf829-5f4c-4057-a231-bf96af6082f8 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1365 microversion: 2.1 time: 0.152634 May 17 18:27:21.073858 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 523/990] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:20 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:21.180085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a3df42f4-0338-4b1d-aae2-36789d8d9393 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:21.180702 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a3df42f4-0338-4b1d-aae2-36789d8d9393 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:21.186540 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3df42f4-0338-4b1d-aae2-36789d8d9393 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:21.186991 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3df42f4-0338-4b1d-aae2-36789d8d9393 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:21.187791 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3df42f4-0338-4b1d-aae2-36789d8d9393 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:21.188234 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a3df42f4-0338-4b1d-aae2-36789d8d9393 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:21.247794 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a3df42f4-0338-4b1d-aae2-36789d8d9393 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:21.255291 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a3df42f4-0338-4b1d-aae2-36789d8d9393 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1135 microversion: 2.1 time: 0.079018 May 17 18:27:21.255843 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 524/991] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:21 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1135 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:21.447151 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-62229e56-3f9a-401c-9bc9-06723ed6edd4 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "POST /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.052694 May 17 18:27:21.452688 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 468/992] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:27:20 2022] POST /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments => generated 194 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:21.889892 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-994196b9-25d6-4fc7-a686-539277a7378a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:21.891289 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-994196b9-25d6-4fc7-a686-539277a7378a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:21.899563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-994196b9-25d6-4fc7-a686-539277a7378a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:21.900092 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-994196b9-25d6-4fc7-a686-539277a7378a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:21.901712 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-994196b9-25d6-4fc7-a686-539277a7378a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:21.902230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-994196b9-25d6-4fc7-a686-539277a7378a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:22.069162 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-994196b9-25d6-4fc7-a686-539277a7378a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:22.077991 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-994196b9-25d6-4fc7-a686-539277a7378a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:22.080330 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-994196b9-25d6-4fc7-a686-539277a7378a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:22.081931 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-994196b9-25d6-4fc7-a686-539277a7378a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.195966 May 17 18:27:22.083229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 525/993] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:21 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:27:22.091231 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-16f49b72-cac0-4483-bdb3-b9ad3ad2f972 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:22.092057 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-16f49b72-cac0-4483-bdb3-b9ad3ad2f972 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:22.102994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-16f49b72-cac0-4483-bdb3-b9ad3ad2f972 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:22.103491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-16f49b72-cac0-4483-bdb3-b9ad3ad2f972 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:22.104347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-16f49b72-cac0-4483-bdb3-b9ad3ad2f972 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:22.104836 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-16f49b72-cac0-4483-bdb3-b9ad3ad2f972 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:22.262320 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-16f49b72-cac0-4483-bdb3-b9ad3ad2f972 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:22.272919 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5567a63b-0bd7-4fab-9506-244dcf3fdd86 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:22.273678 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5567a63b-0bd7-4fab-9506-244dcf3fdd86 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:22.279302 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-16f49b72-cac0-4483-bdb3-b9ad3ad2f972 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1365 microversion: 2.1 time: 0.192497 May 17 18:27:22.282729 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5567a63b-0bd7-4fab-9506-244dcf3fdd86 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:22.283881 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 469/994] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:22 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:22.284581 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5567a63b-0bd7-4fab-9506-244dcf3fdd86 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:22.285394 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5567a63b-0bd7-4fab-9506-244dcf3fdd86 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:22.285899 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5567a63b-0bd7-4fab-9506-244dcf3fdd86 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:22.355456 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5567a63b-0bd7-4fab-9506-244dcf3fdd86 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:22.364089 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5567a63b-0bd7-4fab-9506-244dcf3fdd86 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1209 microversion: 2.1 time: 0.095242 May 17 18:27:22.365268 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 526/995] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:22 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1209 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:23.101680 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f26a5b11-2344-4f27-9136-8fd8510ab74e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:23.102840 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f26a5b11-2344-4f27-9136-8fd8510ab74e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:23.110510 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f26a5b11-2344-4f27-9136-8fd8510ab74e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:23.111218 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f26a5b11-2344-4f27-9136-8fd8510ab74e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:23.112190 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f26a5b11-2344-4f27-9136-8fd8510ab74e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:23.113027 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f26a5b11-2344-4f27-9136-8fd8510ab74e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:23.265019 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f26a5b11-2344-4f27-9136-8fd8510ab74e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:23.275615 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f26a5b11-2344-4f27-9136-8fd8510ab74e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:23.277177 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f26a5b11-2344-4f27-9136-8fd8510ab74e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:23.278874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f26a5b11-2344-4f27-9136-8fd8510ab74e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.182603 May 17 18:27:23.280163 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 470/996] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:23 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:23.300463 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4f0385db-115f-45da-8a22-f09669b28caa tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:23.301167 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4f0385db-115f-45da-8a22-f09669b28caa tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:23.307966 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4f0385db-115f-45da-8a22-f09669b28caa tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:23.308653 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4f0385db-115f-45da-8a22-f09669b28caa tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:23.309687 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4f0385db-115f-45da-8a22-f09669b28caa tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:23.310289 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4f0385db-115f-45da-8a22-f09669b28caa tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:23.351560 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-3daf82f1-cc53-432b-8957-5ac4744a9682 req-a30e0d5e-5642-4465-ad29-d397b186b250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f5e07c-0b46-457f-b50b-c60529a9ca25", "tag": "55227826-2e6b-4311-b687-c5996676ed3b"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:23.361422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-3daf82f1-cc53-432b-8957-5ac4744a9682 req-a30e0d5e-5642-4465-ad29-d397b186b250 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:23.362059 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-3daf82f1-cc53-432b-8957-5ac4744a9682 req-a30e0d5e-5642-4465-ad29-d397b186b250 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:23.383337 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-3daf82f1-cc53-432b-8957-5ac4744a9682 req-a30e0d5e-5642-4465-ad29-d397b186b250 service nova] Creating event network-changed:55227826-2e6b-4311-b687-c5996676ed3b for instance f5f5e07c-0b46-457f-b50b-c60529a9ca25 on hv-cinder-83736 May 17 18:27:23.388614 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-3daf82f1-cc53-432b-8957-5ac4744a9682 req-a30e0d5e-5642-4465-ad29-d397b186b250 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047381 May 17 18:27:23.389224 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 471/997] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:27:23.401080 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6d61b0a9-8677-4152-b211-6fb3f56ba160 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:23.402133 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6d61b0a9-8677-4152-b211-6fb3f56ba160 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:23.413579 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6d61b0a9-8677-4152-b211-6fb3f56ba160 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:23.414324 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6d61b0a9-8677-4152-b211-6fb3f56ba160 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:23.415859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6d61b0a9-8677-4152-b211-6fb3f56ba160 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:23.416480 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6d61b0a9-8677-4152-b211-6fb3f56ba160 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:23.533312 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4f0385db-115f-45da-8a22-f09669b28caa tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:23.542397 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4f0385db-115f-45da-8a22-f09669b28caa tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1365 microversion: 2.1 time: 0.246184 May 17 18:27:23.543628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 527/998] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:23 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:23.694701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-6d61b0a9-8677-4152-b211-6fb3f56ba160 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:23.704988 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6d61b0a9-8677-4152-b211-6fb3f56ba160 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1277 microversion: 2.1 time: 0.310354 May 17 18:27:23.705738 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 472/999] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:23 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1277 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:24.297401 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-268c5552-a353-4a64-97f7-04dc46d6858e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:24.298050 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-268c5552-a353-4a64-97f7-04dc46d6858e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:24.304218 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-268c5552-a353-4a64-97f7-04dc46d6858e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:24.304821 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-268c5552-a353-4a64-97f7-04dc46d6858e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:24.305439 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-268c5552-a353-4a64-97f7-04dc46d6858e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:24.305895 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-268c5552-a353-4a64-97f7-04dc46d6858e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:24.463589 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-268c5552-a353-4a64-97f7-04dc46d6858e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:24.472056 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-268c5552-a353-4a64-97f7-04dc46d6858e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:24.473678 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-268c5552-a353-4a64-97f7-04dc46d6858e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:24.474883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-268c5552-a353-4a64-97f7-04dc46d6858e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.181480 May 17 18:27:24.486769 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 528/1000] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:24 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:24.560909 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-51a6faec-c472-4ba4-a0a9-f37280bb4c81 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:24.561700 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-51a6faec-c472-4ba4-a0a9-f37280bb4c81 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:24.568364 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-51a6faec-c472-4ba4-a0a9-f37280bb4c81 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:24.569245 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-51a6faec-c472-4ba4-a0a9-f37280bb4c81 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:24.570062 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-51a6faec-c472-4ba4-a0a9-f37280bb4c81 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:24.570509 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-51a6faec-c472-4ba4-a0a9-f37280bb4c81 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:24.723224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7bcead39-c01b-4212-b2f8-01667e2a710f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:24.723845 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7bcead39-c01b-4212-b2f8-01667e2a710f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:24.743274 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7bcead39-c01b-4212-b2f8-01667e2a710f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:24.744115 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7bcead39-c01b-4212-b2f8-01667e2a710f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:24.745132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7bcead39-c01b-4212-b2f8-01667e2a710f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:24.745769 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7bcead39-c01b-4212-b2f8-01667e2a710f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:24.745905 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-51a6faec-c472-4ba4-a0a9-f37280bb4c81 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:24.755615 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-51a6faec-c472-4ba4-a0a9-f37280bb4c81 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1365 microversion: 2.1 time: 0.199159 May 17 18:27:24.756186 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 473/1001] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:24 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:24.892133 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7bcead39-c01b-4212-b2f8-01667e2a710f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:24.899549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7bcead39-c01b-4212-b2f8-01667e2a710f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1277 microversion: 2.1 time: 0.181799 May 17 18:27:24.900116 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 529/1002] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:24 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:25.306772 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-ab6a5cf3-1636-4570-990e-4a0b2cd8f921 req-7fb67a30-f522-4c6a-9466-96bc16522b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c9a311-51ca-496a-8f5b-48a1815795f5", "name": "network-vif-plugged", "status": "completed", "tag": "645fe4e9-8733-46d7-af17-34167be8896b"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:25.316595 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-ab6a5cf3-1636-4570-990e-4a0b2cd8f921 req-7fb67a30-f522-4c6a-9466-96bc16522b05 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:25.317064 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-ab6a5cf3-1636-4570-990e-4a0b2cd8f921 req-7fb67a30-f522-4c6a-9466-96bc16522b05 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:25.329656 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-ab6a5cf3-1636-4570-990e-4a0b2cd8f921 req-7fb67a30-f522-4c6a-9466-96bc16522b05 service nova] Creating event network-vif-plugged:645fe4e9-8733-46d7-af17-34167be8896b for instance 26c9a311-51ca-496a-8f5b-48a1815795f5 on hv-cinder-83736 May 17 18:27:25.334853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-ab6a5cf3-1636-4570-990e-4a0b2cd8f921 req-7fb67a30-f522-4c6a-9466-96bc16522b05 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032580 May 17 18:27:25.335668 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 474/1003] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:25.493940 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d486f549-f208-4725-9911-2268535c1f77 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:25.494653 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d486f549-f208-4725-9911-2268535c1f77 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:25.501106 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d486f549-f208-4725-9911-2268535c1f77 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:25.501680 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d486f549-f208-4725-9911-2268535c1f77 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:25.502545 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d486f549-f208-4725-9911-2268535c1f77 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:25.503060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d486f549-f208-4725-9911-2268535c1f77 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:25.636265 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d486f549-f208-4725-9911-2268535c1f77 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:25.645263 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d486f549-f208-4725-9911-2268535c1f77 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:25.646840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d486f549-f208-4725-9911-2268535c1f77 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:25.648010 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d486f549-f208-4725-9911-2268535c1f77 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.158035 May 17 18:27:25.648734 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 530/1004] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:25 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:25.775149 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-29c553d1-5f9f-4d0b-a454-ccf5c5485282 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:25.776467 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-29c553d1-5f9f-4d0b-a454-ccf5c5485282 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:25.784774 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-29c553d1-5f9f-4d0b-a454-ccf5c5485282 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:25.785229 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-29c553d1-5f9f-4d0b-a454-ccf5c5485282 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:25.787342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-29c553d1-5f9f-4d0b-a454-ccf5c5485282 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:25.787342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-29c553d1-5f9f-4d0b-a454-ccf5c5485282 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:25.916379 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8b947994-e1ec-4529-8edd-e24df825e275 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:25.917000 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-8b947994-e1ec-4529-8edd-e24df825e275 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:25.922579 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-29c553d1-5f9f-4d0b-a454-ccf5c5485282 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:25.923456 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8b947994-e1ec-4529-8edd-e24df825e275 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:25.923907 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8b947994-e1ec-4529-8edd-e24df825e275 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:25.924715 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8b947994-e1ec-4529-8edd-e24df825e275 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:25.925325 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8b947994-e1ec-4529-8edd-e24df825e275 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:25.930312 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-29c553d1-5f9f-4d0b-a454-ccf5c5485282 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1365 microversion: 2.1 time: 0.160653 May 17 18:27:25.931023 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 475/1005] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:25 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1365 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:26.071289 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-8b947994-e1ec-4529-8edd-e24df825e275 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:26.081171 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8b947994-e1ec-4529-8edd-e24df825e275 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1277 microversion: 2.1 time: 0.168411 May 17 18:27:26.082264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 531/1006] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:25 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:26.666745 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-589b4445-5e2d-4a27-b1a5-7cb77541e4e5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:26.667358 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-589b4445-5e2d-4a27-b1a5-7cb77541e4e5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:26.673916 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-589b4445-5e2d-4a27-b1a5-7cb77541e4e5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:26.674371 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-589b4445-5e2d-4a27-b1a5-7cb77541e4e5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:26.675141 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-589b4445-5e2d-4a27-b1a5-7cb77541e4e5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:26.675585 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-589b4445-5e2d-4a27-b1a5-7cb77541e4e5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:26.818102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-589b4445-5e2d-4a27-b1a5-7cb77541e4e5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:26.826168 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-589b4445-5e2d-4a27-b1a5-7cb77541e4e5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:26.827686 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-589b4445-5e2d-4a27-b1a5-7cb77541e4e5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:26.828857 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-589b4445-5e2d-4a27-b1a5-7cb77541e4e5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.166116 May 17 18:27:26.829444 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 476/1007] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:26 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:26.948767 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cd8c5e4a-b257-48b5-ad90-58f9872dcd67 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:26.949302 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cd8c5e4a-b257-48b5-ad90-58f9872dcd67 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:26.955920 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd8c5e4a-b257-48b5-ad90-58f9872dcd67 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:26.956367 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd8c5e4a-b257-48b5-ad90-58f9872dcd67 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:26.957139 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd8c5e4a-b257-48b5-ad90-58f9872dcd67 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:26.957602 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cd8c5e4a-b257-48b5-ad90-58f9872dcd67 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:27.096879 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cd8c5e4a-b257-48b5-ad90-58f9872dcd67 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:27.099037 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-429855c1-2d77-4b4d-bd1c-20cb9dfdec1a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:27.099656 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-429855c1-2d77-4b4d-bd1c-20cb9dfdec1a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:27.104419 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cd8c5e4a-b257-48b5-ad90-58f9872dcd67 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1365 microversion: 2.1 time: 0.160088 May 17 18:27:27.104983 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 532/1008] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:26 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:27.105421 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-429855c1-2d77-4b4d-bd1c-20cb9dfdec1a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:27.105906 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-429855c1-2d77-4b4d-bd1c-20cb9dfdec1a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:27.106674 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-429855c1-2d77-4b4d-bd1c-20cb9dfdec1a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:27.107113 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-429855c1-2d77-4b4d-bd1c-20cb9dfdec1a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:27.242324 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-429855c1-2d77-4b4d-bd1c-20cb9dfdec1a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:27.249601 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-429855c1-2d77-4b4d-bd1c-20cb9dfdec1a tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1277 microversion: 2.1 time: 0.154313 May 17 18:27:27.250242 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 477/1009] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:27 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:27.847052 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-658e853c-7356-4405-a767-4811195e0281 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:27.847669 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-658e853c-7356-4405-a767-4811195e0281 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:27.853690 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-658e853c-7356-4405-a767-4811195e0281 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:27.854146 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-658e853c-7356-4405-a767-4811195e0281 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:27.854944 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-658e853c-7356-4405-a767-4811195e0281 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:27.855453 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-658e853c-7356-4405-a767-4811195e0281 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:27.983755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-658e853c-7356-4405-a767-4811195e0281 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:27.991632 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-658e853c-7356-4405-a767-4811195e0281 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:27.993403 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-658e853c-7356-4405-a767-4811195e0281 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:27.994834 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-658e853c-7356-4405-a767-4811195e0281 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.151687 May 17 18:27:27.995392 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 533/1010] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:27 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:28.121826 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-32dd5574-d322-4e4f-b87c-578670552deb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:28.123014 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-32dd5574-d322-4e4f-b87c-578670552deb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:28.129974 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32dd5574-d322-4e4f-b87c-578670552deb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:28.130424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32dd5574-d322-4e4f-b87c-578670552deb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:28.131406 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32dd5574-d322-4e4f-b87c-578670552deb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:28.131853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-32dd5574-d322-4e4f-b87c-578670552deb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:28.267659 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2f4bf498-460f-4e92-a555-f70eb7718d6f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:28.268284 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2f4bf498-460f-4e92-a555-f70eb7718d6f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:28.274330 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2f4bf498-460f-4e92-a555-f70eb7718d6f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:28.274846 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2f4bf498-460f-4e92-a555-f70eb7718d6f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:28.275632 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2f4bf498-460f-4e92-a555-f70eb7718d6f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:28.276074 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2f4bf498-460f-4e92-a555-f70eb7718d6f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:28.474202 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2f4bf498-460f-4e92-a555-f70eb7718d6f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:28.481496 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2f4bf498-460f-4e92-a555-f70eb7718d6f tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1277 microversion: 2.1 time: 0.218112 May 17 18:27:28.482263 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 534/1011] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:28 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:28.485552 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-32dd5574-d322-4e4f-b87c-578670552deb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:28.493395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-32dd5574-d322-4e4f-b87c-578670552deb tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1555 microversion: 2.1 time: 0.375453 May 17 18:27:28.494013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 478/1012] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:28 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1555 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:28.510349 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f374bde3-cc87-422e-b23e-e3e42a7fb9a0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:28.510851 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f374bde3-cc87-422e-b23e-e3e42a7fb9a0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:28.516720 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f374bde3-cc87-422e-b23e-e3e42a7fb9a0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:28.517172 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f374bde3-cc87-422e-b23e-e3e42a7fb9a0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:28.517977 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f374bde3-cc87-422e-b23e-e3e42a7fb9a0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:28.518634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f374bde3-cc87-422e-b23e-e3e42a7fb9a0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:28.595588 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f374bde3-cc87-422e-b23e-e3e42a7fb9a0 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088985 May 17 18:27:28.596184 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 535/1013] 10.222.0.65 () {58 vars in 1274 bytes} [Tue May 17 18:27:28 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:28.949617 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-069d6941-e96b-4241-b582-ca222e5f6fb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:28.951001 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-069d6941-e96b-4241-b582-ca222e5f6fb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:28.957603 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-069d6941-e96b-4241-b582-ca222e5f6fb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:28.958180 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-069d6941-e96b-4241-b582-ca222e5f6fb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:28.959053 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-069d6941-e96b-4241-b582-ca222e5f6fb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:28.959573 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-069d6941-e96b-4241-b582-ca222e5f6fb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:28.990086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-069d6941-e96b-4241-b582-ca222e5f6fb6 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044296 May 17 18:27:28.990557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 479/1014] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:27:28 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:29.000762 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b7a1a54a-3735-43bd-9976-8a6f55ca207f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:29.001297 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b7a1a54a-3735-43bd-9976-8a6f55ca207f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:29.007973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b7a1a54a-3735-43bd-9976-8a6f55ca207f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:29.007973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b7a1a54a-3735-43bd-9976-8a6f55ca207f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:29.012987 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-bc45b771-81a2-41e7-8f65-2edae8473bbb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:29.013637 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-bc45b771-81a2-41e7-8f65-2edae8473bbb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:29.014037 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b7a1a54a-3735-43bd-9976-8a6f55ca207f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:29.014509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b7a1a54a-3735-43bd-9976-8a6f55ca207f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:29.020136 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc45b771-81a2-41e7-8f65-2edae8473bbb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:29.020713 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc45b771-81a2-41e7-8f65-2edae8473bbb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:29.021989 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc45b771-81a2-41e7-8f65-2edae8473bbb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:29.022480 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc45b771-81a2-41e7-8f65-2edae8473bbb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:29.051312 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b7a1a54a-3735-43bd-9976-8a6f55ca207f tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments/088fbd39-e429-4765-9316-19e1af0a148b" status: 200 len: 194 microversion: 2.1 time: 0.054874 May 17 18:27:29.052085 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 536/1015] 10.222.0.65 () {58 vars in 1412 bytes} [Tue May 17 18:27:28 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments/088fbd39-e429-4765-9316-19e1af0a148b => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:27:29.277504 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bc45b771-81a2-41e7-8f65-2edae8473bbb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:29.286989 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bc45b771-81a2-41e7-8f65-2edae8473bbb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:29.288843 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bc45b771-81a2-41e7-8f65-2edae8473bbb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:29.290556 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-bc45b771-81a2-41e7-8f65-2edae8473bbb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.281356 May 17 18:27:29.291372 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 480/1016] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:29 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:29.498734 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6e0594c1-01f6-4aa6-a8a0-dfda53763cc6 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:29.499258 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6e0594c1-01f6-4aa6-a8a0-dfda53763cc6 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:29.505046 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6e0594c1-01f6-4aa6-a8a0-dfda53763cc6 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:29.505526 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6e0594c1-01f6-4aa6-a8a0-dfda53763cc6 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:29.506313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6e0594c1-01f6-4aa6-a8a0-dfda53763cc6 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:29.506733 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6e0594c1-01f6-4aa6-a8a0-dfda53763cc6 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:29.721216 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-29cbdcb8-9c37-47ed-9cf1-475e34dc3835 req-b88d135d-a7eb-4142-aa04-b30c0901bed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26c9a311-51ca-496a-8f5b-48a1815795f5", "tag": "645fe4e9-8733-46d7-af17-34167be8896b"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:29.730091 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-29cbdcb8-9c37-47ed-9cf1-475e34dc3835 req-b88d135d-a7eb-4142-aa04-b30c0901bed2 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:29.730546 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-29cbdcb8-9c37-47ed-9cf1-475e34dc3835 req-b88d135d-a7eb-4142-aa04-b30c0901bed2 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:29.742709 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-29cbdcb8-9c37-47ed-9cf1-475e34dc3835 req-b88d135d-a7eb-4142-aa04-b30c0901bed2 service nova] Creating event network-changed:645fe4e9-8733-46d7-af17-34167be8896b for instance 26c9a311-51ca-496a-8f5b-48a1815795f5 on hv-cinder-83736 May 17 18:27:29.747992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-29cbdcb8-9c37-47ed-9cf1-475e34dc3835 req-b88d135d-a7eb-4142-aa04-b30c0901bed2 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031158 May 17 18:27:29.748918 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 481/1017] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:27:29.765048 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6e0594c1-01f6-4aa6-a8a0-dfda53763cc6 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:29.773105 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6e0594c1-01f6-4aa6-a8a0-dfda53763cc6 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.278373 May 17 18:27:29.774061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 537/1018] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:29 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:30.315065 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e0c1300b-11c6-496f-a085-9ae790eba68f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:30.315895 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e0c1300b-11c6-496f-a085-9ae790eba68f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:30.322653 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0c1300b-11c6-496f-a085-9ae790eba68f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:30.323217 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0c1300b-11c6-496f-a085-9ae790eba68f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:30.325021 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0c1300b-11c6-496f-a085-9ae790eba68f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:30.326327 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e0c1300b-11c6-496f-a085-9ae790eba68f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:30.435391 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a08382a6-5f2a-4a10-86a0-aa7fe0d89617 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de4cdb8b-5411-42a7-b06d-bafc6eed2867"}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:30.436542 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a08382a6-5f2a-4a10-86a0-aa7fe0d89617 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:30.444295 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a08382a6-5f2a-4a10-86a0-aa7fe0d89617 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:30.444765 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a08382a6-5f2a-4a10-86a0-aa7fe0d89617 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:30.445612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a08382a6-5f2a-4a10-86a0-aa7fe0d89617 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:30.446062 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a08382a6-5f2a-4a10-86a0-aa7fe0d89617 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:30.470599 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e0c1300b-11c6-496f-a085-9ae790eba68f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:30.478934 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e0c1300b-11c6-496f-a085-9ae790eba68f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:30.480467 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e0c1300b-11c6-496f-a085-9ae790eba68f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:30.481737 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e0c1300b-11c6-496f-a085-9ae790eba68f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.171991 May 17 18:27:30.485811 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 482/1019] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:30 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:30.791219 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-bc7aa1d7-2a3a-4cb2-ad2d-713de89731a1 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:30.792334 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-bc7aa1d7-2a3a-4cb2-ad2d-713de89731a1 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:30.799250 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc7aa1d7-2a3a-4cb2-ad2d-713de89731a1 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:30.799715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc7aa1d7-2a3a-4cb2-ad2d-713de89731a1 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:30.800504 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc7aa1d7-2a3a-4cb2-ad2d-713de89731a1 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:30.800949 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc7aa1d7-2a3a-4cb2-ad2d-713de89731a1 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:30.942171 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bc7aa1d7-2a3a-4cb2-ad2d-713de89731a1 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:30.949837 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-bc7aa1d7-2a3a-4cb2-ad2d-713de89731a1 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.162730 May 17 18:27:30.950512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 483/1020] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:30 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:31.210225 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a08382a6-5f2a-4a10-86a0-aa7fe0d89617 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "POST /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.778654 May 17 18:27:31.215414 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 538/1021] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:27:30 2022] POST /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:27:31.500214 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-932b9192-4d51-4b46-85f7-249f667f1b9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:31.500839 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-932b9192-4d51-4b46-85f7-249f667f1b9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:31.507334 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-932b9192-4d51-4b46-85f7-249f667f1b9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:31.507801 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-932b9192-4d51-4b46-85f7-249f667f1b9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:31.508620 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-932b9192-4d51-4b46-85f7-249f667f1b9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:31.509068 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-932b9192-4d51-4b46-85f7-249f667f1b9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:31.643275 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-932b9192-4d51-4b46-85f7-249f667f1b9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:31.651547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-932b9192-4d51-4b46-85f7-249f667f1b9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:31.653050 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-932b9192-4d51-4b46-85f7-249f667f1b9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:31.654284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-932b9192-4d51-4b46-85f7-249f667f1b9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1745 microversion: 2.20 time: 0.158073 May 17 18:27:31.654845 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 484/1022] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:31 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1745 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:31.970199 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6d7611e2-b03a-42e0-8e3b-dedca13906d4 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:31.970828 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6d7611e2-b03a-42e0-8e3b-dedca13906d4 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:31.977036 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d7611e2-b03a-42e0-8e3b-dedca13906d4 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:31.977517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d7611e2-b03a-42e0-8e3b-dedca13906d4 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:31.978320 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d7611e2-b03a-42e0-8e3b-dedca13906d4 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:31.978759 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d7611e2-b03a-42e0-8e3b-dedca13906d4 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:32.109243 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6d7611e2-b03a-42e0-8e3b-dedca13906d4 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:32.117080 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6d7611e2-b03a-42e0-8e3b-dedca13906d4 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.151791 May 17 18:27:32.117657 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 539/1023] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:31 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:32.674317 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9187aea1-60cd-4aad-b677-53a929dee4fb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:32.674935 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-9187aea1-60cd-4aad-b677-53a929dee4fb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:32.681293 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9187aea1-60cd-4aad-b677-53a929dee4fb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:32.681778 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9187aea1-60cd-4aad-b677-53a929dee4fb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:32.682553 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9187aea1-60cd-4aad-b677-53a929dee4fb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:32.682994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9187aea1-60cd-4aad-b677-53a929dee4fb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:32.809481 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-9187aea1-60cd-4aad-b677-53a929dee4fb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:32.817427 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-9187aea1-60cd-4aad-b677-53a929dee4fb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:32.818956 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-9187aea1-60cd-4aad-b677-53a929dee4fb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:32.820124 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9187aea1-60cd-4aad-b677-53a929dee4fb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1745 microversion: 2.20 time: 0.149804 May 17 18:27:32.820689 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 485/1024] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:32 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1745 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:33.134336 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ed7169c4-c5fd-4bae-8365-79c8e9bfe785 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:33.135033 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ed7169c4-c5fd-4bae-8365-79c8e9bfe785 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:33.141705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed7169c4-c5fd-4bae-8365-79c8e9bfe785 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:33.142170 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed7169c4-c5fd-4bae-8365-79c8e9bfe785 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:33.142986 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed7169c4-c5fd-4bae-8365-79c8e9bfe785 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:33.143475 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ed7169c4-c5fd-4bae-8365-79c8e9bfe785 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:33.273644 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ed7169c4-c5fd-4bae-8365-79c8e9bfe785 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:33.281135 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ed7169c4-c5fd-4bae-8365-79c8e9bfe785 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.150642 May 17 18:27:33.281721 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 540/1025] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:33 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:33.838979 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8638135b-fa3b-4c27-9b5d-4821e6b6c1d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:33.839597 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8638135b-fa3b-4c27-9b5d-4821e6b6c1d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:33.847543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8638135b-fa3b-4c27-9b5d-4821e6b6c1d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:33.848152 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8638135b-fa3b-4c27-9b5d-4821e6b6c1d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:33.849131 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8638135b-fa3b-4c27-9b5d-4821e6b6c1d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:33.849820 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8638135b-fa3b-4c27-9b5d-4821e6b6c1d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:33.983352 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8638135b-fa3b-4c27-9b5d-4821e6b6c1d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:33.991671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8638135b-fa3b-4c27-9b5d-4821e6b6c1d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:33.993166 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8638135b-fa3b-4c27-9b5d-4821e6b6c1d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:33.994359 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8638135b-fa3b-4c27-9b5d-4821e6b6c1d5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1745 microversion: 2.20 time: 0.159336 May 17 18:27:33.994916 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 486/1026] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:33 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:34.298529 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6d792597-6dd0-42dd-baac-2d0364dfbaad tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:34.299144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6d792597-6dd0-42dd-baac-2d0364dfbaad tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:34.305400 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d792597-6dd0-42dd-baac-2d0364dfbaad tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:34.305894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d792597-6dd0-42dd-baac-2d0364dfbaad tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:34.306655 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d792597-6dd0-42dd-baac-2d0364dfbaad tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:34.307220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d792597-6dd0-42dd-baac-2d0364dfbaad tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:34.444829 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6d792597-6dd0-42dd-baac-2d0364dfbaad tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:34.452765 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6d792597-6dd0-42dd-baac-2d0364dfbaad tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.158105 May 17 18:27:34.453332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 541/1027] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:34 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:35.012060 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-fb044229-dbfc-4bb9-b14b-b6e301d99911 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:35.012669 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-fb044229-dbfc-4bb9-b14b-b6e301d99911 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:35.019106 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fb044229-dbfc-4bb9-b14b-b6e301d99911 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:35.019557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fb044229-dbfc-4bb9-b14b-b6e301d99911 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:35.020436 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fb044229-dbfc-4bb9-b14b-b6e301d99911 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:35.020878 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-fb044229-dbfc-4bb9-b14b-b6e301d99911 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:35.151733 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-fb044229-dbfc-4bb9-b14b-b6e301d99911 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:35.159979 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-fb044229-dbfc-4bb9-b14b-b6e301d99911 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:35.161524 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-fb044229-dbfc-4bb9-b14b-b6e301d99911 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:35.162805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-fb044229-dbfc-4bb9-b14b-b6e301d99911 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1745 microversion: 2.20 time: 0.154628 May 17 18:27:35.163471 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 487/1028] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:35 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:35.404285 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-1fbde298-dd79-4041-afde-22487d582685 req-1c38ffe1-a324-4f47-b317-bf332a4b92ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d4de87-f1c0-4e32-9c17-09a87a23dc55", "name": "network-vif-plugged", "status": "completed", "tag": "9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:35.414516 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-1fbde298-dd79-4041-afde-22487d582685 req-1c38ffe1-a324-4f47-b317-bf332a4b92ce service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:35.415696 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-1fbde298-dd79-4041-afde-22487d582685 req-1c38ffe1-a324-4f47-b317-bf332a4b92ce service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:35.429866 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-1fbde298-dd79-4041-afde-22487d582685 req-1c38ffe1-a324-4f47-b317-bf332a4b92ce service nova] Creating event network-vif-plugged:9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f for instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 on hv-cinder-83736 May 17 18:27:35.435817 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-1fbde298-dd79-4041-afde-22487d582685 req-1c38ffe1-a324-4f47-b317-bf332a4b92ce service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035217 May 17 18:27:35.437015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 542/1029] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:35.471977 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-eba8d475-5b74-49b3-b8cd-bfdce45fc3ae tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:35.471977 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-eba8d475-5b74-49b3-b8cd-bfdce45fc3ae tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:35.477825 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-eba8d475-5b74-49b3-b8cd-bfdce45fc3ae tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:35.478281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-eba8d475-5b74-49b3-b8cd-bfdce45fc3ae tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:35.479055 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-eba8d475-5b74-49b3-b8cd-bfdce45fc3ae tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:35.479508 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-eba8d475-5b74-49b3-b8cd-bfdce45fc3ae tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:35.610888 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-eba8d475-5b74-49b3-b8cd-bfdce45fc3ae tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:35.618958 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-eba8d475-5b74-49b3-b8cd-bfdce45fc3ae tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.153023 May 17 18:27:35.619543 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 488/1030] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:35 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:36.182195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-df1f26ba-efa2-4685-8410-d1fe276e8058 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:36.182906 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-df1f26ba-efa2-4685-8410-d1fe276e8058 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:36.189302 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-df1f26ba-efa2-4685-8410-d1fe276e8058 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:36.189782 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-df1f26ba-efa2-4685-8410-d1fe276e8058 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:36.190573 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-df1f26ba-efa2-4685-8410-d1fe276e8058 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:36.191019 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-df1f26ba-efa2-4685-8410-d1fe276e8058 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:36.322830 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-df1f26ba-efa2-4685-8410-d1fe276e8058 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:36.331182 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-df1f26ba-efa2-4685-8410-d1fe276e8058 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:36.332699 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-df1f26ba-efa2-4685-8410-d1fe276e8058 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:36.333983 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-df1f26ba-efa2-4685-8410-d1fe276e8058 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1745 microversion: 2.20 time: 0.156140 May 17 18:27:36.334492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 543/1031] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:36 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:36.635819 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8d185643-f52d-40a6-ba7b-5cede5094535 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:36.636440 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8d185643-f52d-40a6-ba7b-5cede5094535 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:36.643240 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d185643-f52d-40a6-ba7b-5cede5094535 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:36.643689 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d185643-f52d-40a6-ba7b-5cede5094535 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:36.644454 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d185643-f52d-40a6-ba7b-5cede5094535 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:36.644892 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d185643-f52d-40a6-ba7b-5cede5094535 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:36.781680 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8d185643-f52d-40a6-ba7b-5cede5094535 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:36.789075 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8d185643-f52d-40a6-ba7b-5cede5094535 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.157068 May 17 18:27:36.789665 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 489/1032] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:36 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:37.351909 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6270de9b-2fa0-48ae-b477-5a8fcaf7094b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:37.352528 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6270de9b-2fa0-48ae-b477-5a8fcaf7094b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:37.358978 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6270de9b-2fa0-48ae-b477-5a8fcaf7094b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:37.359432 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6270de9b-2fa0-48ae-b477-5a8fcaf7094b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:37.360200 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6270de9b-2fa0-48ae-b477-5a8fcaf7094b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:37.361152 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6270de9b-2fa0-48ae-b477-5a8fcaf7094b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:37.484846 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6270de9b-2fa0-48ae-b477-5a8fcaf7094b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:37.493062 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6270de9b-2fa0-48ae-b477-5a8fcaf7094b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:37.494600 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6270de9b-2fa0-48ae-b477-5a8fcaf7094b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:37.495759 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6270de9b-2fa0-48ae-b477-5a8fcaf7094b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1745 microversion: 2.20 time: 0.147780 May 17 18:27:37.496315 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 544/1033] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:37 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1745 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:37.805714 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9d088598-6b4e-443e-b662-1fc4952c3658 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:37.806340 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-9d088598-6b4e-443e-b662-1fc4952c3658 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:37.812634 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d088598-6b4e-443e-b662-1fc4952c3658 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:37.813094 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d088598-6b4e-443e-b662-1fc4952c3658 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:37.813906 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d088598-6b4e-443e-b662-1fc4952c3658 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:37.814352 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d088598-6b4e-443e-b662-1fc4952c3658 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:37.945905 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-9d088598-6b4e-443e-b662-1fc4952c3658 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:37.953373 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9d088598-6b4e-443e-b662-1fc4952c3658 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.151586 May 17 18:27:37.954456 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 490/1034] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:37 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:38.513826 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-806b5136-8c13-4f62-b4ab-2880f6008591 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:38.514505 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-806b5136-8c13-4f62-b4ab-2880f6008591 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:38.521416 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-806b5136-8c13-4f62-b4ab-2880f6008591 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:38.521960 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-806b5136-8c13-4f62-b4ab-2880f6008591 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:38.522729 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-806b5136-8c13-4f62-b4ab-2880f6008591 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:38.523172 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-806b5136-8c13-4f62-b4ab-2880f6008591 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:38.663086 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-806b5136-8c13-4f62-b4ab-2880f6008591 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:38.671038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-806b5136-8c13-4f62-b4ab-2880f6008591 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:38.672549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-806b5136-8c13-4f62-b4ab-2880f6008591 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:38.674248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-806b5136-8c13-4f62-b4ab-2880f6008591 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1745 microversion: 2.20 time: 0.164330 May 17 18:27:38.674797 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 545/1035] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:38 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:38.970628 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-5b945f52-3f45-4961-bfe9-9fe19996ff74 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:38.971250 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-5b945f52-3f45-4961-bfe9-9fe19996ff74 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:38.977628 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5b945f52-3f45-4961-bfe9-9fe19996ff74 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:38.978083 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5b945f52-3f45-4961-bfe9-9fe19996ff74 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:38.978854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5b945f52-3f45-4961-bfe9-9fe19996ff74 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:38.979299 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-5b945f52-3f45-4961-bfe9-9fe19996ff74 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:39.114188 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-5b945f52-3f45-4961-bfe9-9fe19996ff74 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:39.121396 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-5b945f52-3f45-4961-bfe9-9fe19996ff74 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.154765 May 17 18:27:39.121982 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 491/1036] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:38 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:39.692161 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b30921db-45f3-424b-b36a-560e3a943973 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:39.692912 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b30921db-45f3-424b-b36a-560e3a943973 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:39.699258 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b30921db-45f3-424b-b36a-560e3a943973 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:39.699713 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b30921db-45f3-424b-b36a-560e3a943973 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:39.700483 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b30921db-45f3-424b-b36a-560e3a943973 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:39.701203 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b30921db-45f3-424b-b36a-560e3a943973 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:39.755751 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-38dcd1be-a684-4216-98f8-dbecef032326 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:39.756729 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-38dcd1be-a684-4216-98f8-dbecef032326 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:39.762865 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-38dcd1be-a684-4216-98f8-dbecef032326 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:39.763512 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-38dcd1be-a684-4216-98f8-dbecef032326 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:39.764293 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-38dcd1be-a684-4216-98f8-dbecef032326 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:39.764732 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-38dcd1be-a684-4216-98f8-dbecef032326 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:39.795899 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-38dcd1be-a684-4216-98f8-dbecef032326 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043914 May 17 18:27:39.796395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 492/1037] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:27:39 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:27:39.834383 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b30921db-45f3-424b-b36a-560e3a943973 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:39.842951 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b30921db-45f3-424b-b36a-560e3a943973 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:39.844718 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b30921db-45f3-424b-b36a-560e3a943973 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:39.846109 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b30921db-45f3-424b-b36a-560e3a943973 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.157906 May 17 18:27:39.847183 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 546/1038] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:39 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:39.941665 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d0494c66-3e61-40f2-be88-8261d2025949 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:39.942356 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d0494c66-3e61-40f2-be88-8261d2025949 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:39.948936 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d0494c66-3e61-40f2-be88-8261d2025949 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:39.949667 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d0494c66-3e61-40f2-be88-8261d2025949 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:39.951666 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d0494c66-3e61-40f2-be88-8261d2025949 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:39.952323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d0494c66-3e61-40f2-be88-8261d2025949 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:39.984297 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d0494c66-3e61-40f2-be88-8261d2025949 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments/088fbd39-e429-4765-9316-19e1af0a148b" status: 200 len: 194 microversion: 2.1 time: 0.048250 May 17 18:27:39.986130 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 493/1039] 10.222.0.65 () {58 vars in 1412 bytes} [Tue May 17 18:27:39 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments/088fbd39-e429-4765-9316-19e1af0a148b => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:39.995382 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e856a23a-2861-42c6-acf8-108d5f054409 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:39.995893 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e856a23a-2861-42c6-acf8-108d5f054409 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:40.004282 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e856a23a-2861-42c6-acf8-108d5f054409 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:40.004745 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e856a23a-2861-42c6-acf8-108d5f054409 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:40.005569 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e856a23a-2861-42c6-acf8-108d5f054409 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:40.006015 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e856a23a-2861-42c6-acf8-108d5f054409 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:40.091089 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-e856a23a-2861-42c6-acf8-108d5f054409 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lazy-loading 'services' on Instance uuid 8e325b5f-1d56-4055-829d-f41198c02382 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:27:40.138554 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7d5dd9cb-1589-40e9-8f78-e8bbd15bf853 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:40.139177 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7d5dd9cb-1589-40e9-8f78-e8bbd15bf853 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:40.145346 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7d5dd9cb-1589-40e9-8f78-e8bbd15bf853 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:40.145845 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7d5dd9cb-1589-40e9-8f78-e8bbd15bf853 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:40.146629 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7d5dd9cb-1589-40e9-8f78-e8bbd15bf853 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:40.147071 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7d5dd9cb-1589-40e9-8f78-e8bbd15bf853 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:40.165962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e856a23a-2861-42c6-acf8-108d5f054409 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments/088fbd39-e429-4765-9316-19e1af0a148b" status: 202 len: 0 microversion: 2.1 time: 0.174013 May 17 18:27:40.167048 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 547/1040] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:27:39 2022] DELETE /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments/088fbd39-e429-4765-9316-19e1af0a148b => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:27:40.330738 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7d5dd9cb-1589-40e9-8f78-e8bbd15bf853 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:40.338925 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7d5dd9cb-1589-40e9-8f78-e8bbd15bf853 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.204234 May 17 18:27:40.339492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 494/1041] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:40 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:40.866315 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2070747b-62fb-4b2d-9125-c5237223596d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:40.867070 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2070747b-62fb-4b2d-9125-c5237223596d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:40.881954 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2070747b-62fb-4b2d-9125-c5237223596d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:40.882634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2070747b-62fb-4b2d-9125-c5237223596d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:40.883751 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2070747b-62fb-4b2d-9125-c5237223596d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:40.884268 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2070747b-62fb-4b2d-9125-c5237223596d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:41.022746 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2070747b-62fb-4b2d-9125-c5237223596d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:41.030797 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2070747b-62fb-4b2d-9125-c5237223596d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:41.032368 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2070747b-62fb-4b2d-9125-c5237223596d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:41.033751 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2070747b-62fb-4b2d-9125-c5237223596d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.173429 May 17 18:27:41.034485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 548/1042] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:40 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:41.356717 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d4ce709b-4fbb-4acd-841e-2e8333a23082 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:41.358192 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d4ce709b-4fbb-4acd-841e-2e8333a23082 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:41.366715 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d4ce709b-4fbb-4acd-841e-2e8333a23082 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:41.367295 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d4ce709b-4fbb-4acd-841e-2e8333a23082 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:41.368344 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d4ce709b-4fbb-4acd-841e-2e8333a23082 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:41.369117 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d4ce709b-4fbb-4acd-841e-2e8333a23082 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:41.477297 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-3fe03f93-57a1-4193-aabb-313ad90cfba1 req-7ecfd4bd-0c88-4ba6-b061-8fb1ff94c491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f5e07c-0b46-457f-b50b-c60529a9ca25", "name": "network-vif-plugged", "status": "completed", "tag": "55227826-2e6b-4311-b687-c5996676ed3b"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:41.492752 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-3fe03f93-57a1-4193-aabb-313ad90cfba1 req-7ecfd4bd-0c88-4ba6-b061-8fb1ff94c491 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:41.493425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-3fe03f93-57a1-4193-aabb-313ad90cfba1 req-7ecfd4bd-0c88-4ba6-b061-8fb1ff94c491 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:41.516867 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-3fe03f93-57a1-4193-aabb-313ad90cfba1 req-7ecfd4bd-0c88-4ba6-b061-8fb1ff94c491 service nova] Creating event network-vif-plugged:55227826-2e6b-4311-b687-c5996676ed3b for instance f5f5e07c-0b46-457f-b50b-c60529a9ca25 on hv-cinder-83736 May 17 18:27:41.527003 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-3fe03f93-57a1-4193-aabb-313ad90cfba1 req-7ecfd4bd-0c88-4ba6-b061-8fb1ff94c491 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053344 May 17 18:27:41.528492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 549/1043] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:27:41.580614 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d4ce709b-4fbb-4acd-841e-2e8333a23082 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:41.591480 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d4ce709b-4fbb-4acd-841e-2e8333a23082 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.239465 May 17 18:27:41.592607 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 495/1044] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:41 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:42.053187 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-20e8ea46-d561-4059-9522-55f9107bc6bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:42.053868 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-20e8ea46-d561-4059-9522-55f9107bc6bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:42.060557 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20e8ea46-d561-4059-9522-55f9107bc6bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:42.061046 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20e8ea46-d561-4059-9522-55f9107bc6bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:42.061878 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20e8ea46-d561-4059-9522-55f9107bc6bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:42.062320 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-20e8ea46-d561-4059-9522-55f9107bc6bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:42.201177 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-20e8ea46-d561-4059-9522-55f9107bc6bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:42.209700 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-20e8ea46-d561-4059-9522-55f9107bc6bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:42.211261 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-20e8ea46-d561-4059-9522-55f9107bc6bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:42.212949 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-20e8ea46-d561-4059-9522-55f9107bc6bb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.163939 May 17 18:27:42.213621 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 550/1045] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:42 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:42.356595 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-88ad4f60-06f5-4d3e-bcc6-875a5298a55e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:42.357389 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-88ad4f60-06f5-4d3e-bcc6-875a5298a55e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:42.365740 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-88ad4f60-06f5-4d3e-bcc6-875a5298a55e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:42.366202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-88ad4f60-06f5-4d3e-bcc6-875a5298a55e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:42.367023 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-88ad4f60-06f5-4d3e-bcc6-875a5298a55e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:42.367468 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-88ad4f60-06f5-4d3e-bcc6-875a5298a55e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:42.400407 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-88ad4f60-06f5-4d3e-bcc6-875a5298a55e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments/de4cdb8b-5411-42a7-b06d-bafc6eed2867" status: 200 len: 194 microversion: 2.1 time: 0.048232 May 17 18:27:42.401021 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 496/1046] 10.222.0.65 () {58 vars in 1412 bytes} [Tue May 17 18:27:42 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments/de4cdb8b-5411-42a7-b06d-bafc6eed2867 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:42.410841 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2157c4e2-74ba-4e5f-b6ba-2898980adc21 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:42.411338 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2157c4e2-74ba-4e5f-b6ba-2898980adc21 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:42.417604 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2157c4e2-74ba-4e5f-b6ba-2898980adc21 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:42.418065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2157c4e2-74ba-4e5f-b6ba-2898980adc21 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:42.418839 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2157c4e2-74ba-4e5f-b6ba-2898980adc21 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:42.419284 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2157c4e2-74ba-4e5f-b6ba-2898980adc21 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:42.499580 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-2157c4e2-74ba-4e5f-b6ba-2898980adc21 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lazy-loading 'services' on Instance uuid 8e325b5f-1d56-4055-829d-f41198c02382 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:27:42.572864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2157c4e2-74ba-4e5f-b6ba-2898980adc21 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments/de4cdb8b-5411-42a7-b06d-bafc6eed2867" status: 202 len: 0 microversion: 2.1 time: 0.165700 May 17 18:27:42.575370 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 551/1047] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:27:42 2022] DELETE /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments/de4cdb8b-5411-42a7-b06d-bafc6eed2867 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:27:42.608718 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-84ba88c7-c4f2-49ca-8260-3b593a43ec91 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:42.609490 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-84ba88c7-c4f2-49ca-8260-3b593a43ec91 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:42.615931 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-84ba88c7-c4f2-49ca-8260-3b593a43ec91 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:42.616450 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-84ba88c7-c4f2-49ca-8260-3b593a43ec91 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:42.617351 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-84ba88c7-c4f2-49ca-8260-3b593a43ec91 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:42.618471 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-84ba88c7-c4f2-49ca-8260-3b593a43ec91 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:42.751662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-84ba88c7-c4f2-49ca-8260-3b593a43ec91 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:42.758967 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-84ba88c7-c4f2-49ca-8260-3b593a43ec91 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.154809 May 17 18:27:42.759536 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 497/1048] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:42 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:43.232633 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-312c1973-7a66-4773-acf8-d99e2417f3cb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:43.233359 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-312c1973-7a66-4773-acf8-d99e2417f3cb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:43.239547 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-312c1973-7a66-4773-acf8-d99e2417f3cb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:43.240005 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-312c1973-7a66-4773-acf8-d99e2417f3cb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:43.240782 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-312c1973-7a66-4773-acf8-d99e2417f3cb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:43.241218 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-312c1973-7a66-4773-acf8-d99e2417f3cb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:43.372559 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-312c1973-7a66-4773-acf8-d99e2417f3cb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:43.380470 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-312c1973-7a66-4773-acf8-d99e2417f3cb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:43.381995 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-312c1973-7a66-4773-acf8-d99e2417f3cb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:43.383145 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-312c1973-7a66-4773-acf8-d99e2417f3cb tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.155217 May 17 18:27:43.383698 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 552/1049] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:43 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:43.776037 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f4984296-1947-4856-b294-49624985d252 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:43.776662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f4984296-1947-4856-b294-49624985d252 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:43.783419 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f4984296-1947-4856-b294-49624985d252 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:43.783871 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f4984296-1947-4856-b294-49624985d252 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:43.784638 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f4984296-1947-4856-b294-49624985d252 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:43.785074 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f4984296-1947-4856-b294-49624985d252 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:43.952013 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f4984296-1947-4856-b294-49624985d252 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:43.961165 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f4984296-1947-4856-b294-49624985d252 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1265 microversion: 2.1 time: 0.189062 May 17 18:27:43.961738 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 498/1050] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:43 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:44.401042 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0a4406be-57bd-48fb-83f6-1374b3996f8c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:44.401707 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0a4406be-57bd-48fb-83f6-1374b3996f8c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:44.408059 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0a4406be-57bd-48fb-83f6-1374b3996f8c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:44.408814 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0a4406be-57bd-48fb-83f6-1374b3996f8c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:44.410391 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0a4406be-57bd-48fb-83f6-1374b3996f8c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:44.410835 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0a4406be-57bd-48fb-83f6-1374b3996f8c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:44.540697 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0a4406be-57bd-48fb-83f6-1374b3996f8c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:44.548715 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0a4406be-57bd-48fb-83f6-1374b3996f8c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:44.550768 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0a4406be-57bd-48fb-83f6-1374b3996f8c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:44.551920 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0a4406be-57bd-48fb-83f6-1374b3996f8c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.154822 May 17 18:27:44.552476 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 553/1051] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:44 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:44.978759 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d8b2ae50-393d-43e5-87d5-e8c98b1bb6a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:44.979584 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d8b2ae50-393d-43e5-87d5-e8c98b1bb6a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:44.986202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d8b2ae50-393d-43e5-87d5-e8c98b1bb6a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:44.986664 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d8b2ae50-393d-43e5-87d5-e8c98b1bb6a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:44.987449 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d8b2ae50-393d-43e5-87d5-e8c98b1bb6a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:44.987921 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d8b2ae50-393d-43e5-87d5-e8c98b1bb6a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:45.125932 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d8b2ae50-393d-43e5-87d5-e8c98b1bb6a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:45.134173 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d8b2ae50-393d-43e5-87d5-e8c98b1bb6a0 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1452 microversion: 2.1 time: 0.159356 May 17 18:27:45.134735 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 499/1052] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:44 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:45.151196 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2111897b-c701-43d7-9bdd-b966515750c9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:45.151810 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2111897b-c701-43d7-9bdd-b966515750c9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:45.158026 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2111897b-c701-43d7-9bdd-b966515750c9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:45.158481 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2111897b-c701-43d7-9bdd-b966515750c9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:45.159322 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2111897b-c701-43d7-9bdd-b966515750c9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:45.159742 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2111897b-c701-43d7-9bdd-b966515750c9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:45.308732 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2111897b-c701-43d7-9bdd-b966515750c9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:45.316568 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2111897b-c701-43d7-9bdd-b966515750c9 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1452 microversion: 2.1 time: 0.169211 May 17 18:27:45.317123 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 554/1053] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:45 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1452 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:45.571534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8224e1f0-6e89-4e0e-8e9c-09e78dbc4b92 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:45.573299 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8224e1f0-6e89-4e0e-8e9c-09e78dbc4b92 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:45.580916 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8224e1f0-6e89-4e0e-8e9c-09e78dbc4b92 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:45.581798 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8224e1f0-6e89-4e0e-8e9c-09e78dbc4b92 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:45.582763 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8224e1f0-6e89-4e0e-8e9c-09e78dbc4b92 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:45.583369 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8224e1f0-6e89-4e0e-8e9c-09e78dbc4b92 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:45.795957 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8224e1f0-6e89-4e0e-8e9c-09e78dbc4b92 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:45.805940 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8224e1f0-6e89-4e0e-8e9c-09e78dbc4b92 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:45.807928 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8224e1f0-6e89-4e0e-8e9c-09e78dbc4b92 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:45.809178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8224e1f0-6e89-4e0e-8e9c-09e78dbc4b92 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.241938 May 17 18:27:45.809768 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 500/1054] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:45 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:45.849361 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5783b3e9-1acf-4c92-bb9d-12eacd5f79ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:45.851366 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5783b3e9-1acf-4c92-bb9d-12eacd5f79ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:45.858823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5783b3e9-1acf-4c92-bb9d-12eacd5f79ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:45.859284 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5783b3e9-1acf-4c92-bb9d-12eacd5f79ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:45.860077 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5783b3e9-1acf-4c92-bb9d-12eacd5f79ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:45.860520 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5783b3e9-1acf-4c92-bb9d-12eacd5f79ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:45.892082 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5783b3e9-1acf-4c92-bb9d-12eacd5f79ba tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047132 May 17 18:27:45.893140 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 555/1055] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:27:45 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:27:46.012628 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-cd9f781a-da20-420a-a786-171b62487b30 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:46.013619 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-cd9f781a-da20-420a-a786-171b62487b30 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:46.020503 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cd9f781a-da20-420a-a786-171b62487b30 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:46.020961 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cd9f781a-da20-420a-a786-171b62487b30 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:46.021806 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cd9f781a-da20-420a-a786-171b62487b30 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:46.022259 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-cd9f781a-da20-420a-a786-171b62487b30 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:46.072694 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-cd9f781a-da20-420a-a786-171b62487b30 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064127 May 17 18:27:46.078311 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 501/1056] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:27:46 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:27:46.139360 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b40f55c0-1ee1-4650-af2c-af5dec8e7498 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:46.140227 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b40f55c0-1ee1-4650-af2c-af5dec8e7498 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:46.152444 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b40f55c0-1ee1-4650-af2c-af5dec8e7498 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:46.152980 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b40f55c0-1ee1-4650-af2c-af5dec8e7498 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:46.154285 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b40f55c0-1ee1-4650-af2c-af5dec8e7498 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:46.154802 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b40f55c0-1ee1-4650-af2c-af5dec8e7498 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:46.193656 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b40f55c0-1ee1-4650-af2c-af5dec8e7498 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Going to try to terminate instance {{(pid=117098) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:27:46.283691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b40f55c0-1ee1-4650-af2c-af5dec8e7498 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 204 len: 0 microversion: 2.1 time: 0.150265 May 17 18:27:46.286246 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 556/1057] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:27:46 2022] DELETE /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:27:46.295637 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4e4bb609-e346-49af-b489-8ef1ef7b35b3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:46.296635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4e4bb609-e346-49af-b489-8ef1ef7b35b3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:46.303370 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4e4bb609-e346-49af-b489-8ef1ef7b35b3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:46.303826 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4e4bb609-e346-49af-b489-8ef1ef7b35b3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:46.304616 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4e4bb609-e346-49af-b489-8ef1ef7b35b3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:46.305060 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4e4bb609-e346-49af-b489-8ef1ef7b35b3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:46.542702 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4e4bb609-e346-49af-b489-8ef1ef7b35b3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:46.553167 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4e4bb609-e346-49af-b489-8ef1ef7b35b3 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1674 microversion: 2.1 time: 0.262261 May 17 18:27:46.553897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 502/1058] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:46 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1674 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:46.828497 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3bbfd5d9-fa93-4dcf-9671-b0c211ad09c9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:46.829240 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3bbfd5d9-fa93-4dcf-9671-b0c211ad09c9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:46.845795 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3bbfd5d9-fa93-4dcf-9671-b0c211ad09c9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:46.846509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3bbfd5d9-fa93-4dcf-9671-b0c211ad09c9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:46.848037 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3bbfd5d9-fa93-4dcf-9671-b0c211ad09c9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:46.848632 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3bbfd5d9-fa93-4dcf-9671-b0c211ad09c9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:47.078293 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3bbfd5d9-fa93-4dcf-9671-b0c211ad09c9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:47.090117 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3bbfd5d9-fa93-4dcf-9671-b0c211ad09c9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:47.091954 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3bbfd5d9-fa93-4dcf-9671-b0c211ad09c9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:47.093004 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3bbfd5d9-fa93-4dcf-9671-b0c211ad09c9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.269068 May 17 18:27:47.104230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 557/1059] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:46 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:47.571184 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-67f24984-e98f-4e13-90a8-2924b5c98f3c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:47.571918 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-67f24984-e98f-4e13-90a8-2924b5c98f3c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:47.579063 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67f24984-e98f-4e13-90a8-2924b5c98f3c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:47.579614 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67f24984-e98f-4e13-90a8-2924b5c98f3c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:47.580617 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67f24984-e98f-4e13-90a8-2924b5c98f3c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:47.581954 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67f24984-e98f-4e13-90a8-2924b5c98f3c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:47.722243 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-117f96cb-ee41-4fbc-b360-dffeaed7c7e0 req-41abf952-1236-47a2-b90c-269eb5476f0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f5e07c-0b46-457f-b50b-c60529a9ca25", "tag": "55227826-2e6b-4311-b687-c5996676ed3b"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:47.735722 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-117f96cb-ee41-4fbc-b360-dffeaed7c7e0 req-41abf952-1236-47a2-b90c-269eb5476f0d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:47.736649 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-117f96cb-ee41-4fbc-b360-dffeaed7c7e0 req-41abf952-1236-47a2-b90c-269eb5476f0d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:47.753773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-117f96cb-ee41-4fbc-b360-dffeaed7c7e0 req-41abf952-1236-47a2-b90c-269eb5476f0d service nova] Creating event network-changed:55227826-2e6b-4311-b687-c5996676ed3b for instance f5f5e07c-0b46-457f-b50b-c60529a9ca25 on hv-cinder-83736 May 17 18:27:47.760864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-117f96cb-ee41-4fbc-b360-dffeaed7c7e0 req-41abf952-1236-47a2-b90c-269eb5476f0d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042038 May 17 18:27:47.762096 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 558/1060] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:47.768699 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-67f24984-e98f-4e13-90a8-2924b5c98f3c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:47.776956 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-67f24984-e98f-4e13-90a8-2924b5c98f3c tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1674 microversion: 2.1 time: 0.209481 May 17 18:27:47.787119 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 503/1061] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:47 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:48.335581 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c7d0e258-b5ab-44e2-a354-e4aaf9de9985 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:48.337249 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c7d0e258-b5ab-44e2-a354-e4aaf9de9985 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:48.349496 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7d0e258-b5ab-44e2-a354-e4aaf9de9985 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:48.350649 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7d0e258-b5ab-44e2-a354-e4aaf9de9985 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:48.351933 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7d0e258-b5ab-44e2-a354-e4aaf9de9985 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:48.353300 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c7d0e258-b5ab-44e2-a354-e4aaf9de9985 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:48.555028 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c7d0e258-b5ab-44e2-a354-e4aaf9de9985 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:48.567249 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c7d0e258-b5ab-44e2-a354-e4aaf9de9985 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:48.568957 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c7d0e258-b5ab-44e2-a354-e4aaf9de9985 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:48.570469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c7d0e258-b5ab-44e2-a354-e4aaf9de9985 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.462287 May 17 18:27:48.582618 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 559/1062] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:48 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:48.794347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-672d8bac-31a3-42df-8957-33ce74453291 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:48.794951 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-672d8bac-31a3-42df-8957-33ce74453291 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:48.801422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-672d8bac-31a3-42df-8957-33ce74453291 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:48.801896 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-672d8bac-31a3-42df-8957-33ce74453291 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:48.802675 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-672d8bac-31a3-42df-8957-33ce74453291 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:48.803180 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-672d8bac-31a3-42df-8957-33ce74453291 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:48.954756 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-672d8bac-31a3-42df-8957-33ce74453291 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:48.967866 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-672d8bac-31a3-42df-8957-33ce74453291 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1674 microversion: 2.1 time: 0.177788 May 17 18:27:48.969127 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 504/1063] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:48 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1674 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:27:49.594532 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-043c16fb-914a-471d-8dac-8fc1d5ff9bae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:49.598719 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-043c16fb-914a-471d-8dac-8fc1d5ff9bae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:49.614434 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-043c16fb-914a-471d-8dac-8fc1d5ff9bae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:49.617337 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-043c16fb-914a-471d-8dac-8fc1d5ff9bae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:49.618583 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-043c16fb-914a-471d-8dac-8fc1d5ff9bae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:49.620899 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-043c16fb-914a-471d-8dac-8fc1d5ff9bae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:49.842485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-043c16fb-914a-471d-8dac-8fc1d5ff9bae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:49.856292 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-043c16fb-914a-471d-8dac-8fc1d5ff9bae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:49.858441 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-043c16fb-914a-471d-8dac-8fc1d5ff9bae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:49.860069 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-043c16fb-914a-471d-8dac-8fc1d5ff9bae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.273392 May 17 18:27:49.872289 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 560/1064] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:49 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:49.972946 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-d882b946-86fd-4104-a885-a23aa199672d req-16f77677-938a-4e6a-a1d6-c745ecc864c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e325b5f-1d56-4055-829d-f41198c02382", "name": "network-vif-deleted", "tag": "cc3e9b30-1b25-4bea-a3bb-d2e98cb94f96"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:27:49.987882 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-d882b946-86fd-4104-a885-a23aa199672d req-16f77677-938a-4e6a-a1d6-c745ecc864c5 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:49.992445 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-020c63cb-8e84-46fc-b7d5-65f51bd23f56 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:49.993067 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-020c63cb-8e84-46fc-b7d5-65f51bd23f56 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:49.993600 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-d882b946-86fd-4104-a885-a23aa199672d req-16f77677-938a-4e6a-a1d6-c745ecc864c5 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:50.000623 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-020c63cb-8e84-46fc-b7d5-65f51bd23f56 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:50.001400 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-020c63cb-8e84-46fc-b7d5-65f51bd23f56 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:50.002403 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-020c63cb-8e84-46fc-b7d5-65f51bd23f56 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:50.003065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-020c63cb-8e84-46fc-b7d5-65f51bd23f56 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:50.017325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-d882b946-86fd-4104-a885-a23aa199672d req-16f77677-938a-4e6a-a1d6-c745ecc864c5 service nova] Creating event network-vif-deleted:cc3e9b30-1b25-4bea-a3bb-d2e98cb94f96 for instance 8e325b5f-1d56-4055-829d-f41198c02382 on hv-cinder-83736 May 17 18:27:50.036551 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-d882b946-86fd-4104-a885-a23aa199672d req-16f77677-938a-4e6a-a1d6-c745ecc864c5 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068812 May 17 18:27:50.037840 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 505/1065] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:27:50.123924 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-020c63cb-8e84-46fc-b7d5-65f51bd23f56 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '356af648841c44eeab0bd9c7f78f600a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7eb45f1cd74f84943f4b991986973d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:50.134765 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-020c63cb-8e84-46fc-b7d5-65f51bd23f56 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 200 len: 1323 microversion: 2.1 time: 0.151918 May 17 18:27:50.145043 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 561/1066] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:49 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:27:50.881181 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-685015df-cf63-4a71-8efe-8c29ed43ba5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:50.881931 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-685015df-cf63-4a71-8efe-8c29ed43ba5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:50.888662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-685015df-cf63-4a71-8efe-8c29ed43ba5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:50.889130 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-685015df-cf63-4a71-8efe-8c29ed43ba5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:50.890271 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-685015df-cf63-4a71-8efe-8c29ed43ba5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:50.890722 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-685015df-cf63-4a71-8efe-8c29ed43ba5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:51.071513 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-685015df-cf63-4a71-8efe-8c29ed43ba5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:51.083112 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-685015df-cf63-4a71-8efe-8c29ed43ba5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:51.086950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-685015df-cf63-4a71-8efe-8c29ed43ba5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:51.088883 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-685015df-cf63-4a71-8efe-8c29ed43ba5f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.213918 May 17 18:27:51.089704 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 506/1067] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:50 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:51.152662 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1c60f649-e182-404c-b5b2-5977c0d32b62 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:51.153953 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-1c60f649-e182-404c-b5b2-5977c0d32b62 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:51.161759 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1c60f649-e182-404c-b5b2-5977c0d32b62 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:51.162222 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1c60f649-e182-404c-b5b2-5977c0d32b62 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:51.163020 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1c60f649-e182-404c-b5b2-5977c0d32b62 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:51.163461 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-1c60f649-e182-404c-b5b2-5977c0d32b62 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:51.181229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-1c60f649-e182-404c-b5b2-5977c0d32b62 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] HTTP exception thrown: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1c60f649-e182-404c-b5b2-5977c0d32b62 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Request method failure captured: May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 HTTP/1.1 May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bInLecLATqR-ppc61l2WGEmEFb7NTAYYrQTGRIfd8bjqN3Qy_FONRMaIknlVJIgB2f13JLnQ0JfbTfu-hzVBeYpHglYCxPqGKyYK375qcXOlIKVGpT5ekFfN9v6zG2m9d_q-SnIBku5kejH2HgYdwz5RJnRn9jBN-RvWObieF3KL0 May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:27:51.190001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 356af648841c44eeab0bd9c7f78f600a May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:51.191536 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '8e325b5f-1d56-4055-829d-f41198c02382'} May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:27:51.192313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:51.193823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:51.196332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1c60f649-e182-404c-b5b2-5977c0d32b62 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Returning 404 to user: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:27:51.197405 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1c60f649-e182-404c-b5b2-5977c0d32b62 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 404 len: 111 microversion: 2.1 time: 0.049452 May 17 18:27:51.198417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 562/1068] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:51 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:27:51.211706 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-99198363-00ed-485d-b297-8520fadcc48e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '.version_select at 0x7f4e602bd1f0>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:51.231863 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-99198363-00ed-485d-b297-8520fadcc48e tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060328470" status: 202 len: 0 microversion: 2.1 time: 0.025075 May 17 18:27:51.232620 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 507/1069] 10.222.0.65 () {58 vars in 1220 bytes} [Tue May 17 18:27:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1060328470 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:27:52.110754 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-22346ac3-1de2-48f3-89ec-eb977e66a721 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:52.113708 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-22346ac3-1de2-48f3-89ec-eb977e66a721 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:52.123192 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22346ac3-1de2-48f3-89ec-eb977e66a721 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:52.124037 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22346ac3-1de2-48f3-89ec-eb977e66a721 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:52.125102 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22346ac3-1de2-48f3-89ec-eb977e66a721 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:52.125788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-22346ac3-1de2-48f3-89ec-eb977e66a721 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:52.330330 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-22346ac3-1de2-48f3-89ec-eb977e66a721 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:52.338984 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-22346ac3-1de2-48f3-89ec-eb977e66a721 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:52.340638 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-22346ac3-1de2-48f3-89ec-eb977e66a721 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:52.342134 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-22346ac3-1de2-48f3-89ec-eb977e66a721 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.236026 May 17 18:27:52.343222 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 563/1070] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:52 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:53.369831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-948c5a19-a262-4aea-b044-7a76b1911d6b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:53.372379 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-948c5a19-a262-4aea-b044-7a76b1911d6b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:53.384409 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-948c5a19-a262-4aea-b044-7a76b1911d6b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:53.385338 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-948c5a19-a262-4aea-b044-7a76b1911d6b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:53.386795 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-948c5a19-a262-4aea-b044-7a76b1911d6b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:53.387659 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-948c5a19-a262-4aea-b044-7a76b1911d6b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:53.574875 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-948c5a19-a262-4aea-b044-7a76b1911d6b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:53.584105 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-948c5a19-a262-4aea-b044-7a76b1911d6b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:53.585772 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-948c5a19-a262-4aea-b044-7a76b1911d6b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:53.587206 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-948c5a19-a262-4aea-b044-7a76b1911d6b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.226247 May 17 18:27:53.588094 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 508/1071] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:53 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:54.431531 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-31d40f28-9d09-4414-b488-269d1d689200 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:54.432053 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-31d40f28-9d09-4414-b488-269d1d689200 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:54.438346 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-31d40f28-9d09-4414-b488-269d1d689200 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:54.438794 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-31d40f28-9d09-4414-b488-269d1d689200 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:54.439556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-31d40f28-9d09-4414-b488-269d1d689200 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:54.439993 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-31d40f28-9d09-4414-b488-269d1d689200 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:54.454468 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-31d40f28-9d09-4414-b488-269d1d689200 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] HTTP exception thrown: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-31d40f28-9d09-4414-b488-269d1d689200 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Request method failure captured: May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: DELETE /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 HTTP/1.1 May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bInLecLATqR-ppc61l2WGEmEFb7NTAYYrQTGRIfd8bjqN3Qy_FONRMaIknlVJIgB2f13JLnQ0JfbTfu-hzVBeYpHglYCxPqGKyYK375qcXOlIKVGpT5ekFfN9v6zG2m9d_q-SnIBku5kejH2HgYdwz5RJnRn9jBN-RvWObieF3KL0 May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:27:54.456103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 356af648841c44eeab0bd9c7f78f600a May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:54.458648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '8e325b5f-1d56-4055-829d-f41198c02382'} May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:27:54.459730 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:54.463344 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:54.464804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-31d40f28-9d09-4414-b488-269d1d689200 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Returning 404 to user: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:27:54.464804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-31d40f28-9d09-4414-b488-269d1d689200 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 404 len: 111 microversion: 2.1 time: 0.029963 May 17 18:27:54.464804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 564/1072] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:27:54 2022] DELETE /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:27:54.466809 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-73bc1eb2-237f-480d-a948-5da4a24b8ecd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:54.467471 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-73bc1eb2-237f-480d-a948-5da4a24b8ecd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8e325b5f-1d56-4055-829d-f41198c02382] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:54.474140 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-73bc1eb2-237f-480d-a948-5da4a24b8ecd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:54.474600 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-73bc1eb2-237f-480d-a948-5da4a24b8ecd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:54.475386 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-73bc1eb2-237f-480d-a948-5da4a24b8ecd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:54.475832 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-73bc1eb2-237f-480d-a948-5da4a24b8ecd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:54.489552 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-73bc1eb2-237f-480d-a948-5da4a24b8ecd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] HTTP exception thrown: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-73bc1eb2-237f-480d-a948-5da4a24b8ecd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Request method failure captured: May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 HTTP/1.1 May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bInLecLATqR-ppc61l2WGEmEFb7NTAYYrQTGRIfd8bjqN3Qy_FONRMaIknlVJIgB2f13JLnQ0JfbTfu-hzVBeYpHglYCxPqGKyYK375qcXOlIKVGpT5ekFfN9v6zG2m9d_q-SnIBku5kejH2HgYdwz5RJnRn9jBN-RvWObieF3KL0 May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:27:54.491187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 356af648841c44eeab0bd9c7f78f600a May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:54.492791 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '8e325b5f-1d56-4055-829d-f41198c02382'} May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:27:54.493854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. May 17 18:27:54.495328 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:27:54.496736 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-73bc1eb2-237f-480d-a948-5da4a24b8ecd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Returning 404 to user: Instance 8e325b5f-1d56-4055-829d-f41198c02382 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:27:54.496736 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-73bc1eb2-237f-480d-a948-5da4a24b8ecd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382" status: 404 len: 111 microversion: 2.1 time: 0.030271 May 17 18:27:54.496736 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 509/1073] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:54 2022] GET /compute/v2.1/servers/8e325b5f-1d56-4055-829d-f41198c02382 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:27:54.606143 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-db1ad9ba-f108-4fc7-93f9-add6254039e6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:54.606758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-db1ad9ba-f108-4fc7-93f9-add6254039e6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:54.613070 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-db1ad9ba-f108-4fc7-93f9-add6254039e6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:54.613544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-db1ad9ba-f108-4fc7-93f9-add6254039e6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:54.614315 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-db1ad9ba-f108-4fc7-93f9-add6254039e6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:54.614752 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-db1ad9ba-f108-4fc7-93f9-add6254039e6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:54.742248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-db1ad9ba-f108-4fc7-93f9-add6254039e6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:54.750010 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-db1ad9ba-f108-4fc7-93f9-add6254039e6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:54.751517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-db1ad9ba-f108-4fc7-93f9-add6254039e6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:54.752672 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-db1ad9ba-f108-4fc7-93f9-add6254039e6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.150456 May 17 18:27:54.753225 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 565/1074] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:54 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:27:55.771121 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d37602de-c653-4279-85bf-baf34a6ce0a6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:55.771744 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d37602de-c653-4279-85bf-baf34a6ce0a6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:55.777926 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d37602de-c653-4279-85bf-baf34a6ce0a6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:55.778331 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d37602de-c653-4279-85bf-baf34a6ce0a6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:55.779107 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d37602de-c653-4279-85bf-baf34a6ce0a6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:55.779554 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d37602de-c653-4279-85bf-baf34a6ce0a6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:55.904764 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d37602de-c653-4279-85bf-baf34a6ce0a6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:55.912453 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d37602de-c653-4279-85bf-baf34a6ce0a6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:55.913978 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d37602de-c653-4279-85bf-baf34a6ce0a6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:55.915131 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d37602de-c653-4279-85bf-baf34a6ce0a6 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.148615 May 17 18:27:55.915681 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 510/1075] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:55 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:56.933762 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b3855212-7b0e-4a3b-9987-9894939da3e3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:56.934373 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b3855212-7b0e-4a3b-9987-9894939da3e3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:56.941339 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3855212-7b0e-4a3b-9987-9894939da3e3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:56.941808 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3855212-7b0e-4a3b-9987-9894939da3e3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:56.942575 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3855212-7b0e-4a3b-9987-9894939da3e3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:56.943008 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b3855212-7b0e-4a3b-9987-9894939da3e3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:57.073873 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b3855212-7b0e-4a3b-9987-9894939da3e3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:57.083279 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b3855212-7b0e-4a3b-9987-9894939da3e3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:57.084788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b3855212-7b0e-4a3b-9987-9894939da3e3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:57.086088 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b3855212-7b0e-4a3b-9987-9894939da3e3 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.156147 May 17 18:27:57.086593 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 566/1076] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:56 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:58.108245 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a0c7f9ee-9b52-4d19-9096-b53a5d2f5e5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:58.108771 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a0c7f9ee-9b52-4d19-9096-b53a5d2f5e5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:58.115603 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0c7f9ee-9b52-4d19-9096-b53a5d2f5e5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:58.116055 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0c7f9ee-9b52-4d19-9096-b53a5d2f5e5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:58.116820 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0c7f9ee-9b52-4d19-9096-b53a5d2f5e5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:58.117260 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a0c7f9ee-9b52-4d19-9096-b53a5d2f5e5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:58.243329 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a0c7f9ee-9b52-4d19-9096-b53a5d2f5e5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:58.251035 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a0c7f9ee-9b52-4d19-9096-b53a5d2f5e5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:58.252576 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a0c7f9ee-9b52-4d19-9096-b53a5d2f5e5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:58.254371 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a0c7f9ee-9b52-4d19-9096-b53a5d2f5e5a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1740 microversion: 2.20 time: 0.150162 May 17 18:27:58.254930 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 511/1077] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:58 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1740 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:59.272899 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-65632011-3b13-40a2-ab55-02d54930c140 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:59.273648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-65632011-3b13-40a2-ab55-02d54930c140 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:59.280022 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65632011-3b13-40a2-ab55-02d54930c140 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:59.280477 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65632011-3b13-40a2-ab55-02d54930c140 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:59.281251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65632011-3b13-40a2-ab55-02d54930c140 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:59.281715 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65632011-3b13-40a2-ab55-02d54930c140 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:59.412959 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-65632011-3b13-40a2-ab55-02d54930c140 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:59.421824 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-65632011-3b13-40a2-ab55-02d54930c140 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:59.423323 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-65632011-3b13-40a2-ab55-02d54930c140 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:27:59.424517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-65632011-3b13-40a2-ab55-02d54930c140 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1722 microversion: 2.20 time: 0.156204 May 17 18:27:59.425072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 567/1078] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:27:59 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:27:59.814110 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9d3df48a-77c2-48b2-90dd-72e7390d6296 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:59.814697 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-9d3df48a-77c2-48b2-90dd-72e7390d6296 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:59.821872 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d3df48a-77c2-48b2-90dd-72e7390d6296 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:59.822434 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d3df48a-77c2-48b2-90dd-72e7390d6296 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:59.823273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d3df48a-77c2-48b2-90dd-72e7390d6296 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:59.823782 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d3df48a-77c2-48b2-90dd-72e7390d6296 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:59.837983 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-9d3df48a-77c2-48b2-90dd-72e7390d6296 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] HTTP exception thrown: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9d3df48a-77c2-48b2-90dd-72e7390d6296 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Request method failure captured: May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: DELETE /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 HTTP/1.1 May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bInLecLATqR-ppc61l2WGEmEFb7NTAYYrQTGRIfd8bjqN3Qy_FONRMaIknlVJIgB2f13JLnQ0JfbTfu-hzVBeYpHglYCxPqGKyYK375qcXOlIKVGpT5ekFfN9v6zG2m9d_q-SnIBku5kejH2HgYdwz5RJnRn9jBN-RvWObieF3KL0 May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:27:59.839747 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 356af648841c44eeab0bd9c7f78f600a May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:27:59.841038 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '8b730dca-866b-4096-9175-6d27c3d35e55'} May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:27:59.841893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:27:59.843198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:27:59.845422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9d3df48a-77c2-48b2-90dd-72e7390d6296 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Returning 404 to user: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:27:59.845422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9d3df48a-77c2-48b2-90dd-72e7390d6296 tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "DELETE /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 404 len: 111 microversion: 2.1 time: 0.030698 May 17 18:27:59.845422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 512/1079] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:27:59 2022] DELETE /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:27:59.852270 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-afafa3a0-2910-4ae7-a866-e2287f5653fd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:27:59.852925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-afafa3a0-2910-4ae7-a866-e2287f5653fd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] [instance: 8b730dca-866b-4096-9175-6d27c3d35e55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:27:59.859301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afafa3a0-2910-4ae7-a866-e2287f5653fd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:59.859763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afafa3a0-2910-4ae7-a866-e2287f5653fd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:59.861648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afafa3a0-2910-4ae7-a866-e2287f5653fd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:27:59.861648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-afafa3a0-2910-4ae7-a866-e2287f5653fd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:27:59.875358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-afafa3a0-2910-4ae7-a866-e2287f5653fd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] HTTP exception thrown: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-afafa3a0-2910-4ae7-a866-e2287f5653fd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Request method failure captured: May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 HTTP/1.1 May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bInLecLATqR-ppc61l2WGEmEFb7NTAYYrQTGRIfd8bjqN3Qy_FONRMaIknlVJIgB2f13JLnQ0JfbTfu-hzVBeYpHglYCxPqGKyYK375qcXOlIKVGpT5ekFfN9v6zG2m9d_q-SnIBku5kejH2HgYdwz5RJnRn9jBN-RvWObieF3KL0 May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:27:59.876911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/cd7eb45f1cd74f84943f4b991986973d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: cd7eb45f1cd74f84943f4b991986973d May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1240414743 May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 356af648841c44eeab0bd9c7f78f600a May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeTestJSON-1240414743-project May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:27:59.878973 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '8b730dca-866b-4096-9175-6d27c3d35e55'} May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:27:59.879890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. May 17 18:27:59.881654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:27:59.882746 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-afafa3a0-2910-4ae7-a866-e2287f5653fd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] Returning 404 to user: Instance 8b730dca-866b-4096-9175-6d27c3d35e55 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:27:59.882746 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-afafa3a0-2910-4ae7-a866-e2287f5653fd tempest-AttachVolumeTestJSON-1240414743 tempest-AttachVolumeTestJSON-1240414743-project] 10.222.0.65 "GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55" status: 404 len: 111 microversion: 2.1 time: 0.033232 May 17 18:27:59.882746 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 568/1080] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:27:59 2022] GET /compute/v2.1/servers/8b730dca-866b-4096-9175-6d27c3d35e55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 18:28:00.443238 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b82abcfe-c1ad-4eae-b2f5-5a03af831dae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:00.443856 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b82abcfe-c1ad-4eae-b2f5-5a03af831dae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:00.449727 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b82abcfe-c1ad-4eae-b2f5-5a03af831dae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:00.450185 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b82abcfe-c1ad-4eae-b2f5-5a03af831dae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:00.450965 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b82abcfe-c1ad-4eae-b2f5-5a03af831dae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:00.451755 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b82abcfe-c1ad-4eae-b2f5-5a03af831dae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:00.579707 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b82abcfe-c1ad-4eae-b2f5-5a03af831dae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:00.588065 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b82abcfe-c1ad-4eae-b2f5-5a03af831dae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:00.589621 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b82abcfe-c1ad-4eae-b2f5-5a03af831dae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:00.590796 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b82abcfe-c1ad-4eae-b2f5-5a03af831dae tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1722 microversion: 2.20 time: 0.151565 May 17 18:28:00.591355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 513/1081] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:00 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:01.611574 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-40a805d6-e807-4cea-bc03-91e8740d4fb8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:01.613891 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-40a805d6-e807-4cea-bc03-91e8740d4fb8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:01.621335 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40a805d6-e807-4cea-bc03-91e8740d4fb8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:01.622312 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40a805d6-e807-4cea-bc03-91e8740d4fb8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:01.623523 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40a805d6-e807-4cea-bc03-91e8740d4fb8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:01.624172 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-40a805d6-e807-4cea-bc03-91e8740d4fb8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:01.848627 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-40a805d6-e807-4cea-bc03-91e8740d4fb8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:01.856615 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-40a805d6-e807-4cea-bc03-91e8740d4fb8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:01.858168 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-40a805d6-e807-4cea-bc03-91e8740d4fb8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:01.859343 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-40a805d6-e807-4cea-bc03-91e8740d4fb8 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1725 microversion: 2.20 time: 0.254220 May 17 18:28:01.860089 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 569/1082] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:01 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:01.877235 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-586d8608-87c3-49b2-894b-d8a556863025 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e0d3529-b8ed-4519-a930-9c42bdc6161f"}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:28:01.878479 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-586d8608-87c3-49b2-894b-d8a556863025 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:01.885623 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-586d8608-87c3-49b2-894b-d8a556863025 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:01.886148 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-586d8608-87c3-49b2-894b-d8a556863025 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:01.887150 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-586d8608-87c3-49b2-894b-d8a556863025 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:01.887808 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-586d8608-87c3-49b2-894b-d8a556863025 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:02.218478 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-586d8608-87c3-49b2-894b-d8a556863025 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "POST /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.345262 May 17 18:28:02.219089 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 514/1083] 10.222.0.65 () {62 vars in 1363 bytes} [Tue May 17 18:28:01 2022] POST /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/os-volume_attachments => generated 188 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 17 18:28:02.336396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-65e67667-c5b7-4f64-a218-ed697d9f1e08 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:02.337226 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-65e67667-c5b7-4f64-a218-ed697d9f1e08 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:02.344272 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65e67667-c5b7-4f64-a218-ed697d9f1e08 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:02.344821 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65e67667-c5b7-4f64-a218-ed697d9f1e08 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:02.345676 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65e67667-c5b7-4f64-a218-ed697d9f1e08 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:02.346120 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-65e67667-c5b7-4f64-a218-ed697d9f1e08 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:02.598628 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-65e67667-c5b7-4f64-a218-ed697d9f1e08 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "DELETE /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/os-volume_attachments/4e0d3529-b8ed-4519-a930-9c42bdc6161f" status: 202 len: 0 microversion: 2.20 time: 0.266319 May 17 18:28:02.599216 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 570/1084] 10.222.0.65 () {60 vars in 1456 bytes} [Tue May 17 18:28:02 2022] DELETE /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/os-volume_attachments/4e0d3529-b8ed-4519-a930-9c42bdc6161f => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 18:28:02.663297 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-73bf167a-35ec-4375-a7eb-de4fc7595a9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:28:02.663868 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-73bf167a-35ec-4375-a7eb-de4fc7595a9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:02.671129 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-73bf167a-35ec-4375-a7eb-de4fc7595a9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:02.671795 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-73bf167a-35ec-4375-a7eb-de4fc7595a9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:02.672726 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-73bf167a-35ec-4375-a7eb-de4fc7595a9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:02.673323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-73bf167a-35ec-4375-a7eb-de4fc7595a9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:02.765040 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-73bf167a-35ec-4375-a7eb-de4fc7595a9c tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "POST /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/action" status: 202 len: 0 microversion: 2.20 time: 0.105346 May 17 18:28:02.765614 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 515/1085] 10.222.0.65 () {62 vars in 1318 bytes} [Tue May 17 18:28:02 2022] POST /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 17 18:28:02.774061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cf068f5b-5eec-4811-8364-b745a514970a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:02.775683 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cf068f5b-5eec-4811-8364-b745a514970a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:02.789236 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf068f5b-5eec-4811-8364-b745a514970a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:02.790543 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf068f5b-5eec-4811-8364-b745a514970a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:02.792385 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf068f5b-5eec-4811-8364-b745a514970a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:02.793655 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cf068f5b-5eec-4811-8364-b745a514970a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:03.003995 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cf068f5b-5eec-4811-8364-b745a514970a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:03.013947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cf068f5b-5eec-4811-8364-b745a514970a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:03.015829 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-cf068f5b-5eec-4811-8364-b745a514970a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:03.017310 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cf068f5b-5eec-4811-8364-b745a514970a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1673 microversion: 2.20 time: 0.247292 May 17 18:28:03.030130 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 571/1086] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:02 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 17 18:28:03.500828 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-3e1cae58-c2ad-44ad-83ff-bb384d532a8a req-6cc4fbe4-d17d-4240-88d0-5645c4178b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d4de87-f1c0-4e32-9c17-09a87a23dc55", "name": "network-vif-unplugged", "status": "completed", "tag": "9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:28:03.517434 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-3e1cae58-c2ad-44ad-83ff-bb384d532a8a req-6cc4fbe4-d17d-4240-88d0-5645c4178b45 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:03.518218 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-3e1cae58-c2ad-44ad-83ff-bb384d532a8a req-6cc4fbe4-d17d-4240-88d0-5645c4178b45 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:03.545820 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.compute.server_external_events [req-3e1cae58-c2ad-44ad-83ff-bb384d532a8a req-6cc4fbe4-d17d-4240-88d0-5645c4178b45 service nova] Unable to find a host for instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55. Dropping event network-vif-unplugged {{(pid=117099) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 17 18:28:03.547231 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-3e1cae58-c2ad-44ad-83ff-bb384d532a8a req-6cc4fbe4-d17d-4240-88d0-5645c4178b45 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.050385 May 17 18:28:03.552997 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 516/1087] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 57 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 17 18:28:04.040189 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d8f516af-aadd-4e35-ad1b-2ebb6afe2b04 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:04.043548 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d8f516af-aadd-4e35-ad1b-2ebb6afe2b04 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:04.056073 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8f516af-aadd-4e35-ad1b-2ebb6afe2b04 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:04.056549 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8f516af-aadd-4e35-ad1b-2ebb6afe2b04 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:04.057487 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8f516af-aadd-4e35-ad1b-2ebb6afe2b04 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:04.057823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d8f516af-aadd-4e35-ad1b-2ebb6afe2b04 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:04.503810 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d8f516af-aadd-4e35-ad1b-2ebb6afe2b04 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:04.512008 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d8f516af-aadd-4e35-ad1b-2ebb6afe2b04 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:04.513606 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d8f516af-aadd-4e35-ad1b-2ebb6afe2b04 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:04.514781 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d8f516af-aadd-4e35-ad1b-2ebb6afe2b04 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1673 microversion: 2.20 time: 0.482368 May 17 18:28:04.515335 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 572/1088] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:04 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1673 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:05.539811 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2ebaf9a4-5b64-4b9f-9547-c52f7ea39a4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:05.540410 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2ebaf9a4-5b64-4b9f-9547-c52f7ea39a4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:05.547022 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2ebaf9a4-5b64-4b9f-9547-c52f7ea39a4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:05.547487 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2ebaf9a4-5b64-4b9f-9547-c52f7ea39a4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:05.548438 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2ebaf9a4-5b64-4b9f-9547-c52f7ea39a4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:05.548880 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2ebaf9a4-5b64-4b9f-9547-c52f7ea39a4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:05.686526 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2ebaf9a4-5b64-4b9f-9547-c52f7ea39a4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:05.695530 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2ebaf9a4-5b64-4b9f-9547-c52f7ea39a4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:05.697275 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2ebaf9a4-5b64-4b9f-9547-c52f7ea39a4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:05.698597 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2ebaf9a4-5b64-4b9f-9547-c52f7ea39a4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.169965 May 17 18:28:05.709785 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 517/1089] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:05 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:06.718101 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7ab46977-2d3c-49ab-8112-778a941cd861 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:06.719977 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7ab46977-2d3c-49ab-8112-778a941cd861 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:06.726465 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7ab46977-2d3c-49ab-8112-778a941cd861 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:06.726925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7ab46977-2d3c-49ab-8112-778a941cd861 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:06.727719 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7ab46977-2d3c-49ab-8112-778a941cd861 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:06.728163 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7ab46977-2d3c-49ab-8112-778a941cd861 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:06.858666 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7ab46977-2d3c-49ab-8112-778a941cd861 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:06.866590 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7ab46977-2d3c-49ab-8112-778a941cd861 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:06.868105 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-7ab46977-2d3c-49ab-8112-778a941cd861 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:06.869273 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7ab46977-2d3c-49ab-8112-778a941cd861 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.155933 May 17 18:28:06.869855 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 573/1090] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:06 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:07.899601 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-c4ebb4bd-fcad-42b1-a4fe-9aa8c42740d9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:07.900280 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-c4ebb4bd-fcad-42b1-a4fe-9aa8c42740d9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:07.910767 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4ebb4bd-fcad-42b1-a4fe-9aa8c42740d9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:07.914346 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4ebb4bd-fcad-42b1-a4fe-9aa8c42740d9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:07.915559 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4ebb4bd-fcad-42b1-a4fe-9aa8c42740d9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:07.919590 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-c4ebb4bd-fcad-42b1-a4fe-9aa8c42740d9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:08.068344 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c4ebb4bd-fcad-42b1-a4fe-9aa8c42740d9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:08.089429 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c4ebb4bd-fcad-42b1-a4fe-9aa8c42740d9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:08.092134 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-c4ebb4bd-fcad-42b1-a4fe-9aa8c42740d9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:08.092560 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-c4ebb4bd-fcad-42b1-a4fe-9aa8c42740d9 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.202010 May 17 18:28:08.103639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 518/1091] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:07 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:09.111802 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-26b82a83-1a25-4fab-bed1-7c509e9aa748 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:09.112458 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-26b82a83-1a25-4fab-bed1-7c509e9aa748 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:09.118804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-26b82a83-1a25-4fab-bed1-7c509e9aa748 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:09.119256 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-26b82a83-1a25-4fab-bed1-7c509e9aa748 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:09.120038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-26b82a83-1a25-4fab-bed1-7c509e9aa748 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:09.120475 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-26b82a83-1a25-4fab-bed1-7c509e9aa748 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:09.259134 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-26b82a83-1a25-4fab-bed1-7c509e9aa748 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:09.269430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-26b82a83-1a25-4fab-bed1-7c509e9aa748 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:09.271250 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-26b82a83-1a25-4fab-bed1-7c509e9aa748 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:09.272459 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-26b82a83-1a25-4fab-bed1-7c509e9aa748 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.165058 May 17 18:28:09.273013 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 574/1092] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:09 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:10.290610 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e251b440-d291-4bd6-8fd1-9a4a691c7943 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:10.291660 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e251b440-d291-4bd6-8fd1-9a4a691c7943 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:10.298622 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e251b440-d291-4bd6-8fd1-9a4a691c7943 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:10.299012 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e251b440-d291-4bd6-8fd1-9a4a691c7943 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:10.299858 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e251b440-d291-4bd6-8fd1-9a4a691c7943 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:10.300289 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e251b440-d291-4bd6-8fd1-9a4a691c7943 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:10.438393 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e251b440-d291-4bd6-8fd1-9a4a691c7943 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:10.446902 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e251b440-d291-4bd6-8fd1-9a4a691c7943 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:10.448411 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e251b440-d291-4bd6-8fd1-9a4a691c7943 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:10.449613 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e251b440-d291-4bd6-8fd1-9a4a691c7943 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.163199 May 17 18:28:10.450181 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 519/1093] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:10 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:11.468895 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-95494362-4bd7-43a1-a6cf-b66c44dab712 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:11.469595 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-95494362-4bd7-43a1-a6cf-b66c44dab712 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:11.476829 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-95494362-4bd7-43a1-a6cf-b66c44dab712 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:11.477284 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-95494362-4bd7-43a1-a6cf-b66c44dab712 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:11.478100 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-95494362-4bd7-43a1-a6cf-b66c44dab712 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:11.478551 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-95494362-4bd7-43a1-a6cf-b66c44dab712 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:11.619243 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-95494362-4bd7-43a1-a6cf-b66c44dab712 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:11.626923 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-95494362-4bd7-43a1-a6cf-b66c44dab712 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:11.628955 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-95494362-4bd7-43a1-a6cf-b66c44dab712 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:11.630133 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-95494362-4bd7-43a1-a6cf-b66c44dab712 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.165941 May 17 18:28:11.630674 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 575/1094] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:11 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:12.649245 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-bf2bac4f-e767-4e8c-b5fc-ce78cad0d67a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:12.650519 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-bf2bac4f-e767-4e8c-b5fc-ce78cad0d67a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:12.658400 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bf2bac4f-e767-4e8c-b5fc-ce78cad0d67a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:12.659408 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bf2bac4f-e767-4e8c-b5fc-ce78cad0d67a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:12.660275 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bf2bac4f-e767-4e8c-b5fc-ce78cad0d67a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:12.660721 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bf2bac4f-e767-4e8c-b5fc-ce78cad0d67a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:12.800000 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bf2bac4f-e767-4e8c-b5fc-ce78cad0d67a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:12.813746 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bf2bac4f-e767-4e8c-b5fc-ce78cad0d67a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:12.815576 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-bf2bac4f-e767-4e8c-b5fc-ce78cad0d67a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:12.816945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-bf2bac4f-e767-4e8c-b5fc-ce78cad0d67a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.172404 May 17 18:28:12.818313 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 520/1095] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:12 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:13.835258 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e3ebd6b0-b52e-4e8b-8208-faa6484490c5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:13.837280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e3ebd6b0-b52e-4e8b-8208-faa6484490c5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:13.843934 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e3ebd6b0-b52e-4e8b-8208-faa6484490c5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:13.844394 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e3ebd6b0-b52e-4e8b-8208-faa6484490c5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:13.845177 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e3ebd6b0-b52e-4e8b-8208-faa6484490c5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:13.845651 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e3ebd6b0-b52e-4e8b-8208-faa6484490c5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:13.973383 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e3ebd6b0-b52e-4e8b-8208-faa6484490c5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:13.982641 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e3ebd6b0-b52e-4e8b-8208-faa6484490c5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:13.984157 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e3ebd6b0-b52e-4e8b-8208-faa6484490c5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:13.985336 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e3ebd6b0-b52e-4e8b-8208-faa6484490c5 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.154025 May 17 18:28:13.986087 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 576/1096] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:13 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:15.005351 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-00c4992c-259e-41bd-b91e-9c4528848811 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:15.006770 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-00c4992c-259e-41bd-b91e-9c4528848811 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:15.030681 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-00c4992c-259e-41bd-b91e-9c4528848811 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:15.031383 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-00c4992c-259e-41bd-b91e-9c4528848811 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:15.032597 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-00c4992c-259e-41bd-b91e-9c4528848811 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:15.034533 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-00c4992c-259e-41bd-b91e-9c4528848811 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:15.242320 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-00c4992c-259e-41bd-b91e-9c4528848811 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:15.250133 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-00c4992c-259e-41bd-b91e-9c4528848811 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:15.251627 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-00c4992c-259e-41bd-b91e-9c4528848811 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:15.253371 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-00c4992c-259e-41bd-b91e-9c4528848811 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.252723 May 17 18:28:15.253969 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 521/1097] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:14 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:16.272844 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-63bb4466-3d5d-4878-9a9d-94e6ebae48ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:16.273631 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-63bb4466-3d5d-4878-9a9d-94e6ebae48ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:16.280186 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-63bb4466-3d5d-4878-9a9d-94e6ebae48ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:16.280641 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-63bb4466-3d5d-4878-9a9d-94e6ebae48ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:16.281420 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-63bb4466-3d5d-4878-9a9d-94e6ebae48ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:16.281886 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-63bb4466-3d5d-4878-9a9d-94e6ebae48ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:16.454901 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-63bb4466-3d5d-4878-9a9d-94e6ebae48ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:16.466202 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-63bb4466-3d5d-4878-9a9d-94e6ebae48ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:16.467694 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-63bb4466-3d5d-4878-9a9d-94e6ebae48ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:16.468864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-63bb4466-3d5d-4878-9a9d-94e6ebae48ea tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.200000 May 17 18:28:16.469410 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 577/1098] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:16 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:17.487580 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b2b70777-ca12-4bcd-9bd8-1c4a7ca48dfa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:17.488195 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b2b70777-ca12-4bcd-9bd8-1c4a7ca48dfa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:17.495048 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2b70777-ca12-4bcd-9bd8-1c4a7ca48dfa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:17.495568 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2b70777-ca12-4bcd-9bd8-1c4a7ca48dfa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:17.496676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2b70777-ca12-4bcd-9bd8-1c4a7ca48dfa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:17.497184 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b2b70777-ca12-4bcd-9bd8-1c4a7ca48dfa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:17.624180 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b2b70777-ca12-4bcd-9bd8-1c4a7ca48dfa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:17.632433 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b2b70777-ca12-4bcd-9bd8-1c4a7ca48dfa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:17.633977 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b2b70777-ca12-4bcd-9bd8-1c4a7ca48dfa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:17.635141 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b2b70777-ca12-4bcd-9bd8-1c4a7ca48dfa tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.151468 May 17 18:28:17.635740 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 522/1099] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:17 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:18.653020 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c0db0611-5c40-4bb1-91f5-e63d86f74780 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:18.653677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c0db0611-5c40-4bb1-91f5-e63d86f74780 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:18.660409 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0db0611-5c40-4bb1-91f5-e63d86f74780 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:18.660860 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0db0611-5c40-4bb1-91f5-e63d86f74780 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:18.661658 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0db0611-5c40-4bb1-91f5-e63d86f74780 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:18.662099 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c0db0611-5c40-4bb1-91f5-e63d86f74780 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:18.793340 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c0db0611-5c40-4bb1-91f5-e63d86f74780 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:18.802105 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c0db0611-5c40-4bb1-91f5-e63d86f74780 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:18.803632 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c0db0611-5c40-4bb1-91f5-e63d86f74780 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:18.804823 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c0db0611-5c40-4bb1-91f5-e63d86f74780 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.155748 May 17 18:28:18.814139 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 578/1100] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:18 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:19.823514 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ca0757c4-74c1-4fc3-bd48-567ed7646a0a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:19.824125 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ca0757c4-74c1-4fc3-bd48-567ed7646a0a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:19.831595 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ca0757c4-74c1-4fc3-bd48-567ed7646a0a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:19.832049 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ca0757c4-74c1-4fc3-bd48-567ed7646a0a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:19.832823 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ca0757c4-74c1-4fc3-bd48-567ed7646a0a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:19.833265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ca0757c4-74c1-4fc3-bd48-567ed7646a0a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:19.959907 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ca0757c4-74c1-4fc3-bd48-567ed7646a0a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:19.967717 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ca0757c4-74c1-4fc3-bd48-567ed7646a0a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:19.969215 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ca0757c4-74c1-4fc3-bd48-567ed7646a0a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:19.970396 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ca0757c4-74c1-4fc3-bd48-567ed7646a0a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.150824 May 17 18:28:19.970949 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 523/1101] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:19 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:20.988566 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-df8ebb84-7e7d-45be-99a5-a00bcb97bd58 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:20.989187 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-df8ebb84-7e7d-45be-99a5-a00bcb97bd58 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:20.995573 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-df8ebb84-7e7d-45be-99a5-a00bcb97bd58 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:20.996026 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-df8ebb84-7e7d-45be-99a5-a00bcb97bd58 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:20.996804 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-df8ebb84-7e7d-45be-99a5-a00bcb97bd58 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:20.997449 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-df8ebb84-7e7d-45be-99a5-a00bcb97bd58 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:21.128518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-df8ebb84-7e7d-45be-99a5-a00bcb97bd58 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:21.136419 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-df8ebb84-7e7d-45be-99a5-a00bcb97bd58 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:21.137962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-df8ebb84-7e7d-45be-99a5-a00bcb97bd58 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:21.139132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-df8ebb84-7e7d-45be-99a5-a00bcb97bd58 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.155068 May 17 18:28:21.139694 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 579/1102] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:20 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:22.157391 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-39388a78-58e1-44a2-9c89-755fa4f6a2ec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:22.158042 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-39388a78-58e1-44a2-9c89-755fa4f6a2ec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:22.164838 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-39388a78-58e1-44a2-9c89-755fa4f6a2ec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:22.165298 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-39388a78-58e1-44a2-9c89-755fa4f6a2ec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:22.166109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-39388a78-58e1-44a2-9c89-755fa4f6a2ec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:22.166558 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-39388a78-58e1-44a2-9c89-755fa4f6a2ec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:22.301009 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-39388a78-58e1-44a2-9c89-755fa4f6a2ec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:22.309519 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-39388a78-58e1-44a2-9c89-755fa4f6a2ec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:22.311371 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-39388a78-58e1-44a2-9c89-755fa4f6a2ec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:22.312531 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-39388a78-58e1-44a2-9c89-755fa4f6a2ec tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.159021 May 17 18:28:22.313231 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 524/1103] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:22 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:23.334023 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-db9f8507-c2de-483c-b307-5856b52f1d01 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:23.334569 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-db9f8507-c2de-483c-b307-5856b52f1d01 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:23.340499 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-db9f8507-c2de-483c-b307-5856b52f1d01 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:23.340953 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-db9f8507-c2de-483c-b307-5856b52f1d01 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:23.341756 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-db9f8507-c2de-483c-b307-5856b52f1d01 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:23.341756 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-db9f8507-c2de-483c-b307-5856b52f1d01 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:23.466061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-db9f8507-c2de-483c-b307-5856b52f1d01 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:23.473848 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-db9f8507-c2de-483c-b307-5856b52f1d01 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:23.475357 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-db9f8507-c2de-483c-b307-5856b52f1d01 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:23.476507 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-db9f8507-c2de-483c-b307-5856b52f1d01 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.146540 May 17 18:28:23.477062 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 580/1104] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:23 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:24.495230 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-06bb8e89-c04c-4f97-90f1-76bcbc562b57 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:24.495838 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-06bb8e89-c04c-4f97-90f1-76bcbc562b57 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:24.502650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-06bb8e89-c04c-4f97-90f1-76bcbc562b57 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:24.503104 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-06bb8e89-c04c-4f97-90f1-76bcbc562b57 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:24.503862 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-06bb8e89-c04c-4f97-90f1-76bcbc562b57 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:24.504297 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-06bb8e89-c04c-4f97-90f1-76bcbc562b57 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:24.632635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-06bb8e89-c04c-4f97-90f1-76bcbc562b57 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:24.640605 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-06bb8e89-c04c-4f97-90f1-76bcbc562b57 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:24.642157 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-06bb8e89-c04c-4f97-90f1-76bcbc562b57 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:24.643932 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-06bb8e89-c04c-4f97-90f1-76bcbc562b57 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.152625 May 17 18:28:24.644487 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 525/1105] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:24 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:25.662657 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0acfc6f0-cf92-4182-a8fc-10edf07eef80 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:25.663384 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-0acfc6f0-cf92-4182-a8fc-10edf07eef80 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:25.669675 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0acfc6f0-cf92-4182-a8fc-10edf07eef80 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:25.670142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0acfc6f0-cf92-4182-a8fc-10edf07eef80 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:25.670895 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0acfc6f0-cf92-4182-a8fc-10edf07eef80 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:25.671336 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-0acfc6f0-cf92-4182-a8fc-10edf07eef80 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:25.796163 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0acfc6f0-cf92-4182-a8fc-10edf07eef80 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:25.803841 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0acfc6f0-cf92-4182-a8fc-10edf07eef80 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:25.805349 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-0acfc6f0-cf92-4182-a8fc-10edf07eef80 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:25.806580 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0acfc6f0-cf92-4182-a8fc-10edf07eef80 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.148484 May 17 18:28:25.807137 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 581/1106] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:25 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:26.824551 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-dbbb3502-fd11-42cc-9d11-ee9159920393 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:26.825168 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-dbbb3502-fd11-42cc-9d11-ee9159920393 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:26.832561 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dbbb3502-fd11-42cc-9d11-ee9159920393 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:26.833020 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dbbb3502-fd11-42cc-9d11-ee9159920393 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:26.833851 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dbbb3502-fd11-42cc-9d11-ee9159920393 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:26.834296 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dbbb3502-fd11-42cc-9d11-ee9159920393 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:26.964992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dbbb3502-fd11-42cc-9d11-ee9159920393 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:26.972802 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dbbb3502-fd11-42cc-9d11-ee9159920393 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:26.974347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dbbb3502-fd11-42cc-9d11-ee9159920393 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:26.975508 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-dbbb3502-fd11-42cc-9d11-ee9159920393 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.154936 May 17 18:28:26.976062 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 526/1107] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:26 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:27.993449 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ccfa2e2c-70ec-4d5b-ac3a-d1878de5fd31 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:27.994090 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ccfa2e2c-70ec-4d5b-ac3a-d1878de5fd31 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:28.000364 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ccfa2e2c-70ec-4d5b-ac3a-d1878de5fd31 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:28.000815 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ccfa2e2c-70ec-4d5b-ac3a-d1878de5fd31 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:28.001611 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ccfa2e2c-70ec-4d5b-ac3a-d1878de5fd31 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:28.002043 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ccfa2e2c-70ec-4d5b-ac3a-d1878de5fd31 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:28.136061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ccfa2e2c-70ec-4d5b-ac3a-d1878de5fd31 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:28.144512 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ccfa2e2c-70ec-4d5b-ac3a-d1878de5fd31 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:28.146065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ccfa2e2c-70ec-4d5b-ac3a-d1878de5fd31 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:28.147230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ccfa2e2c-70ec-4d5b-ac3a-d1878de5fd31 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.157725 May 17 18:28:28.147785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 582/1108] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:27 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:28.849848 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-ae200e53-b6ca-44de-a3fe-990f0e71fd39 req-0c85ab59-5a64-4f80-83e8-051e617f1b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d4de87-f1c0-4e32-9c17-09a87a23dc55", "name": "network-vif-plugged", "status": "completed", "tag": "9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:28:28.857824 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-ae200e53-b6ca-44de-a3fe-990f0e71fd39 req-0c85ab59-5a64-4f80-83e8-051e617f1b8e service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:28.858282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-ae200e53-b6ca-44de-a3fe-990f0e71fd39 req-0c85ab59-5a64-4f80-83e8-051e617f1b8e service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:28.869304 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-ae200e53-b6ca-44de-a3fe-990f0e71fd39 req-0c85ab59-5a64-4f80-83e8-051e617f1b8e service nova] Creating event network-vif-plugged:9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f for instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 on hv-cinder-83736 May 17 18:28:28.874332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-ae200e53-b6ca-44de-a3fe-990f0e71fd39 req-0c85ab59-5a64-4f80-83e8-051e617f1b8e service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143169 May 17 18:28:28.874905 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 527/1109] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:28:29.165652 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-de11def0-793c-4ede-ba29-143a9db8fa9e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:29.166328 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-de11def0-793c-4ede-ba29-143a9db8fa9e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:29.172743 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-de11def0-793c-4ede-ba29-143a9db8fa9e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:29.173208 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-de11def0-793c-4ede-ba29-143a9db8fa9e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:29.174030 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-de11def0-793c-4ede-ba29-143a9db8fa9e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:29.175095 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-de11def0-793c-4ede-ba29-143a9db8fa9e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:29.304380 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-de11def0-793c-4ede-ba29-143a9db8fa9e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:29.312150 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-de11def0-793c-4ede-ba29-143a9db8fa9e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:29.313705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-de11def0-793c-4ede-ba29-143a9db8fa9e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:29.314911 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-de11def0-793c-4ede-ba29-143a9db8fa9e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.153295 May 17 18:28:29.315468 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 583/1110] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:29 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:30.334104 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a25cdde6-48a3-4806-bafb-def082541395 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:30.334803 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a25cdde6-48a3-4806-bafb-def082541395 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:30.341012 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a25cdde6-48a3-4806-bafb-def082541395 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:30.341480 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a25cdde6-48a3-4806-bafb-def082541395 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:30.342252 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a25cdde6-48a3-4806-bafb-def082541395 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:30.342692 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a25cdde6-48a3-4806-bafb-def082541395 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:30.470690 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a25cdde6-48a3-4806-bafb-def082541395 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:30.478949 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a25cdde6-48a3-4806-bafb-def082541395 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:30.480526 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a25cdde6-48a3-4806-bafb-def082541395 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:30.481725 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a25cdde6-48a3-4806-bafb-def082541395 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.152332 May 17 18:28:30.482282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 528/1111] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:30 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:31.500070 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-09804ba4-7233-4e14-85ac-6b31f62c187f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:31.500708 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-09804ba4-7233-4e14-85ac-6b31f62c187f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:31.507792 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-09804ba4-7233-4e14-85ac-6b31f62c187f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:31.508240 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-09804ba4-7233-4e14-85ac-6b31f62c187f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:31.509000 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-09804ba4-7233-4e14-85ac-6b31f62c187f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:31.509435 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-09804ba4-7233-4e14-85ac-6b31f62c187f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:31.640785 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-09804ba4-7233-4e14-85ac-6b31f62c187f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:31.649255 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-09804ba4-7233-4e14-85ac-6b31f62c187f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:31.650842 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-09804ba4-7233-4e14-85ac-6b31f62c187f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:31.652067 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-09804ba4-7233-4e14-85ac-6b31f62c187f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.155881 May 17 18:28:31.652649 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 584/1112] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:31 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:32.670698 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d24dc8c2-e300-4832-893c-d046b9c45774 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:32.671311 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d24dc8c2-e300-4832-893c-d046b9c45774 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:32.678305 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d24dc8c2-e300-4832-893c-d046b9c45774 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:32.678753 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d24dc8c2-e300-4832-893c-d046b9c45774 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:32.679515 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d24dc8c2-e300-4832-893c-d046b9c45774 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:32.679954 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d24dc8c2-e300-4832-893c-d046b9c45774 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:32.807339 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d24dc8c2-e300-4832-893c-d046b9c45774 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:32.815084 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d24dc8c2-e300-4832-893c-d046b9c45774 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:32.816598 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d24dc8c2-e300-4832-893c-d046b9c45774 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:32.817787 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d24dc8c2-e300-4832-893c-d046b9c45774 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.151205 May 17 18:28:32.818342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 529/1113] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:32 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:33.836115 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aec532a4-27a1-4ede-abb1-c0eed46cf16f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:33.836587 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-aec532a4-27a1-4ede-abb1-c0eed46cf16f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:33.842753 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aec532a4-27a1-4ede-abb1-c0eed46cf16f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:33.843213 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aec532a4-27a1-4ede-abb1-c0eed46cf16f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:33.843991 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aec532a4-27a1-4ede-abb1-c0eed46cf16f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:33.844437 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aec532a4-27a1-4ede-abb1-c0eed46cf16f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:33.975862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-aec532a4-27a1-4ede-abb1-c0eed46cf16f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:33.983658 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-aec532a4-27a1-4ede-abb1-c0eed46cf16f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:33.985173 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-aec532a4-27a1-4ede-abb1-c0eed46cf16f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:33.986368 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-aec532a4-27a1-4ede-abb1-c0eed46cf16f tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1731 microversion: 2.20 time: 0.154717 May 17 18:28:33.986926 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 585/1114] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:33 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:28:35.004536 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e3e84834-111a-4c9f-a56e-400dfbc89b17 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:28:35.005155 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e3e84834-111a-4c9f-a56e-400dfbc89b17 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:28:35.011451 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3e84834-111a-4c9f-a56e-400dfbc89b17 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:35.011899 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3e84834-111a-4c9f-a56e-400dfbc89b17 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:35.012662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3e84834-111a-4c9f-a56e-400dfbc89b17 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:28:35.013100 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e3e84834-111a-4c9f-a56e-400dfbc89b17 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:28:35.139947 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e3e84834-111a-4c9f-a56e-400dfbc89b17 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:35.147992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e3e84834-111a-4c9f-a56e-400dfbc89b17 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:35.149579 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e3e84834-111a-4c9f-a56e-400dfbc89b17 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:28:35.150771 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e3e84834-111a-4c9f-a56e-400dfbc89b17 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1718 microversion: 2.20 time: 0.150100 May 17 18:28:35.151332 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 530/1115] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:28:34 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1718 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:29:12.703738 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:29:12.704324 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Tue May 17 18:29:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:29:40.298122 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ab5c6c88-0efd-40ee-9ea8-c25eb0d1fd0d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:29:40.298780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ab5c6c88-0efd-40ee-9ea8-c25eb0d1fd0d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:29:40.304469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ab5c6c88-0efd-40ee-9ea8-c25eb0d1fd0d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:40.304921 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ab5c6c88-0efd-40ee-9ea8-c25eb0d1fd0d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:40.306227 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ab5c6c88-0efd-40ee-9ea8-c25eb0d1fd0d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:40.306663 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ab5c6c88-0efd-40ee-9ea8-c25eb0d1fd0d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:40.329825 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ab5c6c88-0efd-40ee-9ea8-c25eb0d1fd0d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/ips" status: 200 len: 148 microversion: 2.1 time: 0.274873 May 17 18:29:40.330365 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 586/1116] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 17 18:29:40 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/ips => generated 148 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:29:41.654296 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b4188a66-9710-460d-a91b-566ab7e68c7e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6557a3a-2d4f-4ef4-9b6b-4a28d44a17b8"}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:29:41.655424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b4188a66-9710-460d-a91b-566ab7e68c7e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:29:41.661321 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b4188a66-9710-460d-a91b-566ab7e68c7e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:41.661870 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b4188a66-9710-460d-a91b-566ab7e68c7e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:41.662632 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b4188a66-9710-460d-a91b-566ab7e68c7e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:41.663070 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b4188a66-9710-460d-a91b-566ab7e68c7e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:41.928187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b4188a66-9710-460d-a91b-566ab7e68c7e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "POST /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.278837 May 17 18:29:41.928986 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 531/1117] 10.222.0.65 () {60 vars in 1322 bytes} [Tue May 17 18:29:41 2022] POST /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:29:49.518847 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c5ca2420-7789-4cd0-a576-ebc97d86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:29:49.519347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c5ca2420-7789-4cd0-a576-ebc97d86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:29:49.527084 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c5ca2420-7789-4cd0-a576-ebc97d86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:49.527596 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c5ca2420-7789-4cd0-a576-ebc97d86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:49.528505 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c5ca2420-7789-4cd0-a576-ebc97d86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:49.529047 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c5ca2420-7789-4cd0-a576-ebc97d86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:49.618851 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.objects.instance [None req-c5ca2420-7789-4cd0-a576-ebc97d86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lazy-loading 'services' on Instance uuid 26c9a311-51ca-496a-8f5b-48a1815795f5 {{(pid=117098) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:29:49.686757 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c5ca2420-7789-4cd0-a576-ebc97d86b926 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/os-volume_attachments/e6557a3a-2d4f-4ef4-9b6b-4a28d44a17b8" status: 202 len: 0 microversion: 2.1 time: 0.176261 May 17 18:29:49.687459 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 587/1118] 10.222.0.65 () {58 vars in 1415 bytes} [Tue May 17 18:29:49 2022] DELETE /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/os-volume_attachments/e6557a3a-2d4f-4ef4-9b6b-4a28d44a17b8 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:29:49.697077 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7f95af7d-0f76-4d74-aa90-731a1c389537 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:29:49.698210 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7f95af7d-0f76-4d74-aa90-731a1c389537 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:29:49.705481 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7f95af7d-0f76-4d74-aa90-731a1c389537 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:49.705935 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7f95af7d-0f76-4d74-aa90-731a1c389537 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:49.706823 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7f95af7d-0f76-4d74-aa90-731a1c389537 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:49.707884 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7f95af7d-0f76-4d74-aa90-731a1c389537 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:49.741239 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7f95af7d-0f76-4d74-aa90-731a1c389537 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048251 May 17 18:29:49.741565 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 532/1119] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:29:49 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:29:50.753532 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-8cb55e74-e89c-4cf4-a183-6ad1169df305 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:29:50.754660 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-8cb55e74-e89c-4cf4-a183-6ad1169df305 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:29:50.760650 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8cb55e74-e89c-4cf4-a183-6ad1169df305 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:50.761687 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8cb55e74-e89c-4cf4-a183-6ad1169df305 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:50.762464 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8cb55e74-e89c-4cf4-a183-6ad1169df305 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:50.762902 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-8cb55e74-e89c-4cf4-a183-6ad1169df305 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:50.791648 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-8cb55e74-e89c-4cf4-a183-6ad1169df305 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042881 May 17 18:29:50.792242 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 588/1120] 10.222.0.65 () {58 vars in 1301 bytes} [Tue May 17 18:29:50 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 17 18:29:50.849955 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-67bab357-f75b-4cef-b84e-6a3fe57b6e4f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:29:50.850499 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-67bab357-f75b-4cef-b84e-6a3fe57b6e4f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:29:50.856800 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67bab357-f75b-4cef-b84e-6a3fe57b6e4f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:50.857368 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67bab357-f75b-4cef-b84e-6a3fe57b6e4f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:50.858081 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67bab357-f75b-4cef-b84e-6a3fe57b6e4f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:50.858519 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-67bab357-f75b-4cef-b84e-6a3fe57b6e4f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:50.883557 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-67bab357-f75b-4cef-b84e-6a3fe57b6e4f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:29:50.964413 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-67bab357-f75b-4cef-b84e-6a3fe57b6e4f tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 204 len: 0 microversion: 2.1 time: 0.117185 May 17 18:29:50.965052 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 533/1121] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:29:50 2022] DELETE /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:29:50.973262 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6be24783-31e6-4869-9546-7919624a0174 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:29:50.974299 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6be24783-31e6-4869-9546-7919624a0174 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:29:50.981395 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6be24783-31e6-4869-9546-7919624a0174 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:50.981962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6be24783-31e6-4869-9546-7919624a0174 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:50.982788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6be24783-31e6-4869-9546-7919624a0174 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:50.983288 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6be24783-31e6-4869-9546-7919624a0174 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:51.117678 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6be24783-31e6-4869-9546-7919624a0174 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:29:51.125144 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6be24783-31e6-4869-9546-7919624a0174 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1678 microversion: 2.1 time: 0.155778 May 17 18:29:51.125938 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 589/1122] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:29:50 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:29:52.143534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-198992b3-cf1d-4a54-9bf8-e66b9111d29b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:29:52.144437 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-198992b3-cf1d-4a54-9bf8-e66b9111d29b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:29:52.151286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-198992b3-cf1d-4a54-9bf8-e66b9111d29b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:52.152554 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-198992b3-cf1d-4a54-9bf8-e66b9111d29b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:52.153348 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-198992b3-cf1d-4a54-9bf8-e66b9111d29b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:52.153819 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-198992b3-cf1d-4a54-9bf8-e66b9111d29b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:52.322029 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-198992b3-cf1d-4a54-9bf8-e66b9111d29b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:29:52.330461 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-198992b3-cf1d-4a54-9bf8-e66b9111d29b tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1678 microversion: 2.1 time: 0.191425 May 17 18:29:52.331032 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 534/1123] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:29:52 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:29:53.348644 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-52089486-e606-44f5-8785-869d5491ca84 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:29:53.349276 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-52089486-e606-44f5-8785-869d5491ca84 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:29:53.356286 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52089486-e606-44f5-8785-869d5491ca84 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:53.356739 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52089486-e606-44f5-8785-869d5491ca84 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:53.357817 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52089486-e606-44f5-8785-869d5491ca84 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:53.358261 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-52089486-e606-44f5-8785-869d5491ca84 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:53.516423 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-52089486-e606-44f5-8785-869d5491ca84 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '13b4ec46d3cb49faba3f063dcfd644c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37a912f3b6fa407bb4495fb6462250e8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:29:53.525961 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-52089486-e606-44f5-8785-869d5491ca84 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 200 len: 1678 microversion: 2.1 time: 0.182016 May 17 18:29:53.526592 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 590/1124] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:29:53 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:29:54.232639 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-f7f0386a-5dcc-4836-8af7-73393d06d51f req-60e8ec39-da37-413a-a27e-283a3e443e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26c9a311-51ca-496a-8f5b-48a1815795f5", "name": "network-vif-deleted", "tag": "645fe4e9-8733-46d7-af17-34167be8896b"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:29:54.240984 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f7f0386a-5dcc-4836-8af7-73393d06d51f req-60e8ec39-da37-413a-a27e-283a3e443e4d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:54.241436 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-f7f0386a-5dcc-4836-8af7-73393d06d51f req-60e8ec39-da37-413a-a27e-283a3e443e4d service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:54.252979 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-f7f0386a-5dcc-4836-8af7-73393d06d51f req-60e8ec39-da37-413a-a27e-283a3e443e4d service nova] Creating event network-vif-deleted:645fe4e9-8733-46d7-af17-34167be8896b for instance 26c9a311-51ca-496a-8f5b-48a1815795f5 on hv-cinder-83736 May 17 18:29:54.258249 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-f7f0386a-5dcc-4836-8af7-73393d06d51f req-60e8ec39-da37-413a-a27e-283a3e443e4d service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164738 May 17 18:29:54.258858 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 535/1125] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:29:54.548372 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e38820a6-b5d9-4c3f-bec7-1ae3b1ae8c7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:29:54.549958 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e38820a6-b5d9-4c3f-bec7-1ae3b1ae8c7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:29:54.571569 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e38820a6-b5d9-4c3f-bec7-1ae3b1ae8c7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:54.572026 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e38820a6-b5d9-4c3f-bec7-1ae3b1ae8c7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:54.575340 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e38820a6-b5d9-4c3f-bec7-1ae3b1ae8c7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:29:54.575797 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e38820a6-b5d9-4c3f-bec7-1ae3b1ae8c7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:29:54.606620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-e38820a6-b5d9-4c3f-bec7-1ae3b1ae8c7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e38820a6-b5d9-4c3f-bec7-1ae3b1ae8c7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 HTTP/1.1 May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:29:54.608556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:29:54.610280 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '26c9a311-51ca-496a-8f5b-48a1815795f5'} May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:29:54.611239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:29:54.612793 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:29:54.614940 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e38820a6-b5d9-4c3f-bec7-1ae3b1ae8c7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:29:54.616075 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e38820a6-b5d9-4c3f-bec7-1ae3b1ae8c7a tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 404 len: 111 microversion: 2.1 time: 0.076174 May 17 18:29:54.616636 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 591/1126] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:29:54 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:29:54.629572 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6a1f19a1-9c9e-4cb1-b447-ecde0279fd18 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '.version_select at 0x7f4e60348790>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:29:54.652231 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6a1f19a1-9c9e-4cb1-b447-ecde0279fd18 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-424586479" status: 202 len: 0 microversion: 2.1 time: 0.029210 May 17 18:29:54.652816 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 536/1127] 10.222.0.65 () {58 vars in 1217 bytes} [Tue May 17 18:29:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-424586479 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 17 18:30:00.588938 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-515eed69-391a-4de2-bb22-82912a79026d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:00.589441 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-515eed69-391a-4de2-bb22-82912a79026d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:00.595811 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-515eed69-391a-4de2-bb22-82912a79026d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:00.596263 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-515eed69-391a-4de2-bb22-82912a79026d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:00.597036 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-515eed69-391a-4de2-bb22-82912a79026d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:00.597505 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-515eed69-391a-4de2-bb22-82912a79026d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:00.610704 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-515eed69-391a-4de2-bb22-82912a79026d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-515eed69-391a-4de2-bb22-82912a79026d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: DELETE /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 HTTP/1.1 May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:30:00.612230 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:30:00.613854 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '26c9a311-51ca-496a-8f5b-48a1815795f5'} May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:00.614771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:30:00.616251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:00.617771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-515eed69-391a-4de2-bb22-82912a79026d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:00.617771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-515eed69-391a-4de2-bb22-82912a79026d tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 404 len: 111 microversion: 2.1 time: 0.028618 May 17 18:30:00.617771 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 592/1128] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:30:00 2022] DELETE /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:30:00.623597 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8d8a1455-6efd-4669-8c7b-0f060af601d4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:00.624342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8d8a1455-6efd-4669-8c7b-0f060af601d4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 26c9a311-51ca-496a-8f5b-48a1815795f5] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:00.630763 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d8a1455-6efd-4669-8c7b-0f060af601d4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:00.631214 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d8a1455-6efd-4669-8c7b-0f060af601d4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:00.631980 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d8a1455-6efd-4669-8c7b-0f060af601d4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:00.632418 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8d8a1455-6efd-4669-8c7b-0f060af601d4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:00.646079 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-8d8a1455-6efd-4669-8c7b-0f060af601d4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8d8a1455-6efd-4669-8c7b-0f060af601d4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 HTTP/1.1 May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:30:00.647671 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:30:00.649282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '26c9a311-51ca-496a-8f5b-48a1815795f5'} May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:00.650244 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. May 17 18:30:00.651831 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:00.653269 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8d8a1455-6efd-4669-8c7b-0f060af601d4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance 26c9a311-51ca-496a-8f5b-48a1815795f5 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:00.653269 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8d8a1455-6efd-4669-8c7b-0f060af601d4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5" status: 404 len: 111 microversion: 2.1 time: 0.029890 May 17 18:30:00.653269 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 537/1129] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:30:00 2022] GET /compute/v2.1/servers/26c9a311-51ca-496a-8f5b-48a1815795f5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:30:01.774918 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7cb11d11-b81e-4c6f-828f-bc2a4cf200fd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:01.775420 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-7cb11d11-b81e-4c6f-828f-bc2a4cf200fd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:01.782402 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7cb11d11-b81e-4c6f-828f-bc2a4cf200fd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:01.782845 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7cb11d11-b81e-4c6f-828f-bc2a4cf200fd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:01.783600 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7cb11d11-b81e-4c6f-828f-bc2a4cf200fd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:01.784034 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-7cb11d11-b81e-4c6f-828f-bc2a4cf200fd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:01.797060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-7cb11d11-b81e-4c6f-828f-bc2a4cf200fd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7cb11d11-b81e-4c6f-828f-bc2a4cf200fd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: DELETE /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 HTTP/1.1 May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:30:01.798598 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:30:01.800195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '4d5daec8-cf69-4eba-b4e1-6ded1a8cec02'} May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:01.800947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:30:01.802224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:01.803469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-7cb11d11-b81e-4c6f-828f-bc2a4cf200fd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:01.803469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-7cb11d11-b81e-4c6f-828f-bc2a4cf200fd tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 404 len: 111 microversion: 2.1 time: 0.028944 May 17 18:30:01.803469 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 593/1130] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:30:01 2022] DELETE /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:30:01.808444 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-682747e0-6472-4826-9e54-688a61034713 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:01.809066 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-682747e0-6472-4826-9e54-688a61034713 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:01.815368 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-682747e0-6472-4826-9e54-688a61034713 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:01.815852 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-682747e0-6472-4826-9e54-688a61034713 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:01.816633 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-682747e0-6472-4826-9e54-688a61034713 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:01.817077 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-682747e0-6472-4826-9e54-688a61034713 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:01.830961 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-682747e0-6472-4826-9e54-688a61034713 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-682747e0-6472-4826-9e54-688a61034713 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 HTTP/1.1 May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:30:01.832492 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:30:01.834187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '4d5daec8-cf69-4eba-b4e1-6ded1a8cec02'} May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:01.835273 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. May 17 18:30:01.837139 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:01.839786 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-682747e0-6472-4826-9e54-688a61034713 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance 4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:01.839786 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-682747e0-6472-4826-9e54-688a61034713 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02" status: 404 len: 111 microversion: 2.1 time: 0.029425 May 17 18:30:01.839786 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 538/1131] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:30:01 2022] GET /compute/v2.1/servers/4d5daec8-cf69-4eba-b4e1-6ded1a8cec02 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:30:01.842890 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5386f48b-e6f2-4beb-a845-328eeebde7c4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:01.843393 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5386f48b-e6f2-4beb-a845-328eeebde7c4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:01.849662 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5386f48b-e6f2-4beb-a845-328eeebde7c4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:01.850607 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5386f48b-e6f2-4beb-a845-328eeebde7c4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:01.850883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5386f48b-e6f2-4beb-a845-328eeebde7c4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:01.851327 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5386f48b-e6f2-4beb-a845-328eeebde7c4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:01.864667 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-5386f48b-e6f2-4beb-a845-328eeebde7c4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5386f48b-e6f2-4beb-a845-328eeebde7c4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: DELETE /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a HTTP/1.1 May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:30:01.866232 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:30:01.867726 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': 'cc177fc2-a93f-4490-8e44-0774f508720a'} May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:01.868518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:30:01.870072 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:01.871670 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5386f48b-e6f2-4beb-a845-328eeebde7c4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:01.871670 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5386f48b-e6f2-4beb-a845-328eeebde7c4 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 404 len: 111 microversion: 2.1 time: 0.029159 May 17 18:30:01.871670 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 594/1132] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:30:01 2022] DELETE /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:30:01.876210 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-148d4b75-10d8-4e1b-b334-64ff98655e1e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:01.876877 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-148d4b75-10d8-4e1b-b334-64ff98655e1e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: cc177fc2-a93f-4490-8e44-0774f508720a] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:01.882893 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-148d4b75-10d8-4e1b-b334-64ff98655e1e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:01.883344 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-148d4b75-10d8-4e1b-b334-64ff98655e1e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:01.884109 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-148d4b75-10d8-4e1b-b334-64ff98655e1e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:01.884547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-148d4b75-10d8-4e1b-b334-64ff98655e1e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:01.900613 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-148d4b75-10d8-4e1b-b334-64ff98655e1e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-148d4b75-10d8-4e1b-b334-64ff98655e1e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a HTTP/1.1 May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:30:01.902748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:30:01.904395 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': 'cc177fc2-a93f-4490-8e44-0774f508720a'} May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:01.905347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. May 17 18:30:01.906919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:01.908344 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-148d4b75-10d8-4e1b-b334-64ff98655e1e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance cc177fc2-a93f-4490-8e44-0774f508720a could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:01.908344 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-148d4b75-10d8-4e1b-b334-64ff98655e1e tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a" status: 404 len: 111 microversion: 2.1 time: 0.031806 May 17 18:30:01.908344 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 539/1133] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:30:01 2022] GET /compute/v2.1/servers/cc177fc2-a93f-4490-8e44-0774f508720a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:30:07.216864 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aebf8f48-6b0d-4365-a6d8-7e76905fe2e2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:07.217376 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-aebf8f48-6b0d-4365-a6d8-7e76905fe2e2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:07.223764 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aebf8f48-6b0d-4365-a6d8-7e76905fe2e2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:07.224216 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aebf8f48-6b0d-4365-a6d8-7e76905fe2e2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:07.224987 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aebf8f48-6b0d-4365-a6d8-7e76905fe2e2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:07.225423 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aebf8f48-6b0d-4365-a6d8-7e76905fe2e2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:07.239425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-aebf8f48-6b0d-4365-a6d8-7e76905fe2e2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aebf8f48-6b0d-4365-a6d8-7e76905fe2e2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: DELETE /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 HTTP/1.1 May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:30:07.240974 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:30:07.242634 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '83f92bd0-84e7-4e4f-b596-c73c9453ce85'} May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:07.243506 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:30:07.245616 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:07.247494 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aebf8f48-6b0d-4365-a6d8-7e76905fe2e2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:07.247494 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-aebf8f48-6b0d-4365-a6d8-7e76905fe2e2 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "DELETE /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 404 len: 111 microversion: 2.1 time: 0.029347 May 17 18:30:07.247494 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 595/1134] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:30:07 2022] DELETE /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:30:07.251394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e27ef883-2071-42c0-b458-c729f274a361 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:07.252017 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e27ef883-2071-42c0-b458-c729f274a361 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] [instance: 83f92bd0-84e7-4e4f-b596-c73c9453ce85] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:07.257975 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e27ef883-2071-42c0-b458-c729f274a361 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:07.258428 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e27ef883-2071-42c0-b458-c729f274a361 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:07.259200 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e27ef883-2071-42c0-b458-c729f274a361 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:07.259644 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e27ef883-2071-42c0-b458-c729f274a361 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:07.273758 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-e27ef883-2071-42c0-b458-c729f274a361 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] HTTP exception thrown: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e27ef883-2071-42c0-b458-c729f274a361 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Request method failure captured: May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 HTTP/1.1 May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bIQHFm4Qo1PR-PPphB3LF2k9eLNtkTLoHI4im8MQ9SkVN18u2l1NXv23fMjG8ViuhNDJtjkxFYTjeWDvEUBKQwYGSaC_KLNpfGgCkHIfkc0IWzdTjlWcHMpsfS0EN7MFl8KexqQw-9-kNtzEkeCBJqA1A6nI739qVDU_Dcf1-Xo8I May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:30:07.275323 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/37a912f3b6fa407bb4495fb6462250e8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 37a912f3b6fa407bb4495fb6462250e8 May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-490835936 May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 13b4ec46d3cb49faba3f063dcfd644c3 May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-AttachVolumeNegativeTest-490835936-project May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:30:07.277394 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '83f92bd0-84e7-4e4f-b596-c73c9453ce85'} May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:07.278178 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. May 17 18:30:07.280347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:07.281736 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e27ef883-2071-42c0-b458-c729f274a361 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] Returning 404 to user: Instance 83f92bd0-84e7-4e4f-b596-c73c9453ce85 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:07.281736 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e27ef883-2071-42c0-b458-c729f274a361 tempest-AttachVolumeNegativeTest-490835936 tempest-AttachVolumeNegativeTest-490835936-project] 10.222.0.65 "GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85" status: 404 len: 111 microversion: 2.1 time: 0.029587 May 17 18:30:07.281736 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 540/1135] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:30:07 2022] GET /compute/v2.1/servers/83f92bd0-84e7-4e4f-b596-c73c9453ce85 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:30:11.571524 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-45f3c02b-b8fe-4177-a828-a30c05d20048 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] Action: 'create', calling method: .version_select at 0x7f4e5b4d4af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-282087337", "metadata": {"Type": "work"}}} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:30:11.856965 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-45f3c02b-b8fe-4177-a828-a30c05d20048 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] 10.222.0.65 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.393301 May 17 18:30:11.857958 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 596/1136] 10.222.0.65 () {60 vars in 1155 bytes} [Tue May 17 18:30:11 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 17 18:30:11.868604 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7f69858b-5bd0-4b2d-a3e9-4bbe2c314fc6 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] Calling method '.version_select at 0x7f4e6052c3a0>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:11.920913 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7f69858b-5bd0-4b2d-a3e9-4bbe2c314fc6 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3" status: 200 len: 352 microversion: 2.1 time: 0.056139 May 17 18:30:11.921641 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 541/1137] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:30:11 2022] GET /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:30:12.934468 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-eff9fe6c-1e9e-4943-b16b-10ab6d30d696 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] Calling method '.version_select at 0x7f4e5b343700>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:12.983156 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-eff9fe6c-1e9e-4943-b16b-10ab6d30d696 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3" status: 200 len: 353 microversion: 2.1 time: 0.054346 May 17 18:30:12.983719 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 597/1138] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:30:12 2022] GET /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:30:12.995318 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ef601c1c-00f8-4ce6-90e2-a28a553c22a0 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] Calling method '.version_select at 0x7f4e60348af0>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:13.043119 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ef601c1c-00f8-4ce6-90e2-a28a553c22a0 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3" status: 200 len: 353 microversion: 2.1 time: 0.052569 May 17 18:30:13.043698 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 542/1139] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:30:12 2022] GET /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:30:13.060484 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-0dcac2c0-2d92-465f-9736-97e17a0303aa tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] Calling method '.version_select at 0x7f4e5b58b820>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:13.304735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-0dcac2c0-2d92-465f-9736-97e17a0303aa tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] 10.222.0.65 "DELETE /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3" status: 202 len: 0 microversion: 2.1 time: 0.248605 May 17 18:30:13.305386 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 598/1140] 10.222.0.65 () {58 vars in 1247 bytes} [Tue May 17 18:30:13 2022] DELETE /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:30:13.313810 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7d3e80fa-19e3-4129-a8bd-f37ea02d66d0 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] Calling method '.version_select at 0x7f4e6049c5e0>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:13.361250 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7d3e80fa-19e3-4129-a8bd-f37ea02d66d0 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3" status: 200 len: 352 microversion: 2.1 time: 0.051411 May 17 18:30:13.361915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 543/1141] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:30:13 2022] GET /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:30:13.999228 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-cc2bf583-d05e-41ca-bede-d1a7e42db808 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:14.000195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-cc2bf583-d05e-41ca-bede-d1a7e42db808 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:14.006274 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc2bf583-d05e-41ca-bede-d1a7e42db808 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:14.006729 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc2bf583-d05e-41ca-bede-d1a7e42db808 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:14.007493 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc2bf583-d05e-41ca-bede-d1a7e42db808 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:14.007928 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-cc2bf583-d05e-41ca-bede-d1a7e42db808 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:14.036274 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-cc2bf583-d05e-41ca-bede-d1a7e42db808 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.041889 May 17 18:30:14.036818 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 599/1142] 10.222.0.65 () {60 vars in 1342 bytes} [Tue May 17 18:30:13 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:30:14.093233 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ecdc7a5b-8ef6-4005-9c6e-9c3853db3e3b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:14.093769 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ecdc7a5b-8ef6-4005-9c6e-9c3853db3e3b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:14.099973 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ecdc7a5b-8ef6-4005-9c6e-9c3853db3e3b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:14.100424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ecdc7a5b-8ef6-4005-9c6e-9c3853db3e3b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:14.101200 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ecdc7a5b-8ef6-4005-9c6e-9c3853db3e3b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:14.101669 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ecdc7a5b-8ef6-4005-9c6e-9c3853db3e3b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:14.127286 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ecdc7a5b-8ef6-4005-9c6e-9c3853db3e3b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:30:14.198540 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ecdc7a5b-8ef6-4005-9c6e-9c3853db3e3b tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "DELETE /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 204 len: 0 microversion: 2.20 time: 0.109420 May 17 18:30:14.199429 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 544/1143] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 17 18:30:14 2022] DELETE /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 18:30:14.208898 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e2cc8eab-19e8-478f-8aae-13e5e5160814 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:14.209539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e2cc8eab-19e8-478f-8aae-13e5e5160814 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:14.215441 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e2cc8eab-19e8-478f-8aae-13e5e5160814 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:14.215894 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e2cc8eab-19e8-478f-8aae-13e5e5160814 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:14.216665 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e2cc8eab-19e8-478f-8aae-13e5e5160814 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:14.217098 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e2cc8eab-19e8-478f-8aae-13e5e5160814 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:14.353050 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e2cc8eab-19e8-478f-8aae-13e5e5160814 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:14.361331 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e2cc8eab-19e8-478f-8aae-13e5e5160814 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:14.362868 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e2cc8eab-19e8-478f-8aae-13e5e5160814 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:14.364060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e2cc8eab-19e8-478f-8aae-13e5e5160814 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.159388 May 17 18:30:14.364609 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 600/1144] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:30:14 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:30:14.374695 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-546c2863-9c79-4668-9773-47430008eea7 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] Calling method '.version_select at 0x7f4e6052c790>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:14.400631 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-546c2863-9c79-4668-9773-47430008eea7 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] HTTP exception thrown: Volume c41e4ea7-70fa-4756-a531-5636a67337b3 could not be found. May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-546c2863-9c79-4668-9773-47430008eea7 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] Request method failure captured: May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3 HTTP/1.1 May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-mzavX_kk_FK3PLgTryVx0y7fJ_rYAjmjKVaB4zyMMwAJEJboToEx6Ar1CHGOgkPuaNuWQk49382OiSIa1IjQRMCdTCuzkz1ozVCPUT5rSiIBTEPtYOPD2hj4Z0OeRTVWgG3RiXJK1WBzXUbaugzcY-tOPwDdgA4zxwcAZtxY_FZ4Q May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: c66a04a7b6814162bc8a7cc6381a9067 May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-VolumesGetTestJSON-953138660 May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:30:14.402650 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_c66a04a7b6814162bc8a7cc6381a9067"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c66a04a7b6814162bc8a7cc6381a9067"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/c66a04a7b6814162bc8a7cc6381a9067"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/c66a04a7b6814162bc8a7cc6381a9067"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-VolumesGetTestJSON-953138660 May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: c66a04a7b6814162bc8a7cc6381a9067 May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-VolumesGetTestJSON-953138660 May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-VolumesGetTestJSON-953138660-project May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 94f3d33cb141425d959a09201b9b9ca9 May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-VolumesGetTestJSON-953138660-project May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Volume c41e4ea7-70fa-4756-a531-5636a67337b3 could not be found. May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': 'c41e4ea7-70fa-4756-a531-5636a67337b3'} May 17 18:30:14.404325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c41e4ea7-70fa-4756-a531-5636a67337b3 could not be found. (HTTP 404) (Request-ID: req-d7cc863f-7dee-42f1-a91d-69ec7b1a614c) May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:14.405284 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi item = cinderclient( May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 17 18:30:14.407086 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c41e4ea7-70fa-4756-a531-5636a67337b3 could not be found. May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 17 18:30:14.408548 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c41e4ea7-70fa-4756-a531-5636a67337b3 could not be found. May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c41e4ea7-70fa-4756-a531-5636a67337b3 could not be found. May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-546c2863-9c79-4668-9773-47430008eea7 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] Returning 404 to user: Volume c41e4ea7-70fa-4756-a531-5636a67337b3 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-546c2863-9c79-4668-9773-47430008eea7 tempest-VolumesGetTestJSON-953138660 tempest-VolumesGetTestJSON-953138660-project] 10.222.0.65 "GET /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3" status: 404 len: 109 microversion: 2.1 time: 0.034072 May 17 18:30:14.409805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 545/1145] 10.222.0.65 () {58 vars in 1244 bytes} [Tue May 17 18:30:14 2022] GET /compute/v2.1/os-volumes/c41e4ea7-70fa-4756-a531-5636a67337b3 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:30:15.383316 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5ea99421-c909-420f-84f8-8e09e722d63a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:15.386433 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5ea99421-c909-420f-84f8-8e09e722d63a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:15.395491 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5ea99421-c909-420f-84f8-8e09e722d63a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:15.396194 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5ea99421-c909-420f-84f8-8e09e722d63a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:15.397641 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5ea99421-c909-420f-84f8-8e09e722d63a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:15.398496 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5ea99421-c909-420f-84f8-8e09e722d63a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:15.558875 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5ea99421-c909-420f-84f8-8e09e722d63a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:15.572753 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5ea99421-c909-420f-84f8-8e09e722d63a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:15.575544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5ea99421-c909-420f-84f8-8e09e722d63a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:15.578612 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5ea99421-c909-420f-84f8-8e09e722d63a tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.198722 May 17 18:30:15.579837 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 601/1146] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:30:15 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:30:16.604917 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e5170d0b-efb3-44a4-b9c1-07c6d8812dbd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:16.607104 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e5170d0b-efb3-44a4-b9c1-07c6d8812dbd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:16.621952 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e5170d0b-efb3-44a4-b9c1-07c6d8812dbd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:16.622451 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e5170d0b-efb3-44a4-b9c1-07c6d8812dbd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:16.623300 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e5170d0b-efb3-44a4-b9c1-07c6d8812dbd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:16.623985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e5170d0b-efb3-44a4-b9c1-07c6d8812dbd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:16.813153 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e5170d0b-efb3-44a4-b9c1-07c6d8812dbd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:16.822786 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e5170d0b-efb3-44a4-b9c1-07c6d8812dbd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:16.824317 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e5170d0b-efb3-44a4-b9c1-07c6d8812dbd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '43620937739e45d3bb7849f98d0e6cce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '379adfd2520a4d2dba04fca7fa3a1d95', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:16.826359 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e5170d0b-efb3-44a4-b9c1-07c6d8812dbd tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 200 len: 1724 microversion: 2.20 time: 0.225986 May 17 18:30:16.826919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 546/1147] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:30:16 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 17 18:30:17.079642 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-2de1b82e-13a8-4978-8813-46a1f94cbffa req-d9a369e8-9e84-4a26-b762-18b1e3b0e165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54d4de87-f1c0-4e32-9c17-09a87a23dc55", "name": "network-vif-deleted", "tag": "9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:30:17.092799 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-2de1b82e-13a8-4978-8813-46a1f94cbffa req-d9a369e8-9e84-4a26-b762-18b1e3b0e165 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:17.093592 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-2de1b82e-13a8-4978-8813-46a1f94cbffa req-d9a369e8-9e84-4a26-b762-18b1e3b0e165 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:17.106618 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-2de1b82e-13a8-4978-8813-46a1f94cbffa req-d9a369e8-9e84-4a26-b762-18b1e3b0e165 service nova] Creating event network-vif-deleted:9b5d4e0f-1a1c-4dac-9475-c2f09d499b8f for instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 on hv-cinder-83736 May 17 18:30:17.113104 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-2de1b82e-13a8-4978-8813-46a1f94cbffa req-d9a369e8-9e84-4a26-b762-18b1e3b0e165 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037860 May 17 18:30:17.114225 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 602/1148] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:30:17.850790 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-75f2544e-15b7-45d7-bb37-3758ae7dc519 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:17.851997 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-75f2544e-15b7-45d7-bb37-3758ae7dc519 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:17.859857 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-75f2544e-15b7-45d7-bb37-3758ae7dc519 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:17.860336 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-75f2544e-15b7-45d7-bb37-3758ae7dc519 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:17.861111 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-75f2544e-15b7-45d7-bb37-3758ae7dc519 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:17.861749 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-75f2544e-15b7-45d7-bb37-3758ae7dc519 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:17.877242 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-75f2544e-15b7-45d7-bb37-3758ae7dc519 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] HTTP exception thrown: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-75f2544e-15b7-45d7-bb37-3758ae7dc519 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Request method failure captured: May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 HTTP/1.1 May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bK_hOAEprE3oTWKa7r9mpzFeKqR2YiQrXPb_nYxrUjafgbuUscHxCOZkewPOnyx5KXWGAzCg3iw0QiTz98BPc82zAy0s6IKGlcdfpOd-zJnvRkRIQdFaAN9X8iTTNpNKD2KLAhj09pcMT_ww2c1S9lZrXPoFkKn5vKJRI7lYwB4_Q May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:30:17.878835 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 43620937739e45d3bb7849f98d0e6cce May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:17.880654 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '54d4de87-f1c0-4e32-9c17-09a87a23dc55'} May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:17.882355 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:17.883859 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:17.885202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-75f2544e-15b7-45d7-bb37-3758ae7dc519 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Returning 404 to user: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:17.885202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-75f2544e-15b7-45d7-bb37-3758ae7dc519 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 404 len: 111 microversion: 2.20 time: 0.038788 May 17 18:30:17.885202 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 547/1149] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:30:17 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 18:30:17.889899 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-1ac6ecac-3ac3-42aa-899d-7eb6d4a75b10 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '.version_select at 0x7f4e5b343ca0>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:17.913924 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-1ac6ecac-3ac3-42aa-899d-7eb6d4a75b10 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1543471697" status: 204 len: 0 microversion: 2.20 time: 0.028129 May 17 18:30:17.917518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 603/1150] 10.222.0.65 () {60 vars in 1261 bytes} [Tue May 17 18:30:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1543471697 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 17 18:30:19.848006 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1ef917fc-e0fa-47dd-a94f-5123e0b09dd4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:19.848621 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1ef917fc-e0fa-47dd-a94f-5123e0b09dd4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:19.855156 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1ef917fc-e0fa-47dd-a94f-5123e0b09dd4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:19.855622 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1ef917fc-e0fa-47dd-a94f-5123e0b09dd4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:19.856408 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1ef917fc-e0fa-47dd-a94f-5123e0b09dd4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:19.857590 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1ef917fc-e0fa-47dd-a94f-5123e0b09dd4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:19.876312 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-1ef917fc-e0fa-47dd-a94f-5123e0b09dd4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] HTTP exception thrown: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1ef917fc-e0fa-47dd-a94f-5123e0b09dd4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Request method failure captured: May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: DELETE /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 HTTP/1.1 May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bK_hOAEprE3oTWKa7r9mpzFeKqR2YiQrXPb_nYxrUjafgbuUscHxCOZkewPOnyx5KXWGAzCg3iw0QiTz98BPc82zAy0s6IKGlcdfpOd-zJnvRkRIQdFaAN9X8iTTNpNKD2KLAhj09pcMT_ww2c1S9lZrXPoFkKn5vKJRI7lYwB4_Q May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:30:19.877945 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 43620937739e45d3bb7849f98d0e6cce May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:19.879874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '54d4de87-f1c0-4e32-9c17-09a87a23dc55'} May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:19.880748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:19.882243 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:19.884356 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1ef917fc-e0fa-47dd-a94f-5123e0b09dd4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Returning 404 to user: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:19.884356 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1ef917fc-e0fa-47dd-a94f-5123e0b09dd4 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "DELETE /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 404 len: 111 microversion: 2.20 time: 0.035362 May 17 18:30:19.884356 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 548/1151] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 17 18:30:19 2022] DELETE /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 18:30:19.888534 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aea00907-b468-42b7-94e1-05bde7a33ec7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:19.889264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-aea00907-b468-42b7-94e1-05bde7a33ec7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 54d4de87-f1c0-4e32-9c17-09a87a23dc55] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:19.895227 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aea00907-b468-42b7-94e1-05bde7a33ec7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:19.895681 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aea00907-b468-42b7-94e1-05bde7a33ec7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:19.896449 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aea00907-b468-42b7-94e1-05bde7a33ec7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:19.896885 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-aea00907-b468-42b7-94e1-05bde7a33ec7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:19.911838 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-aea00907-b468-42b7-94e1-05bde7a33ec7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] HTTP exception thrown: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aea00907-b468-42b7-94e1-05bde7a33ec7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Request method failure captured: May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 HTTP/1.1 May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bK_hOAEprE3oTWKa7r9mpzFeKqR2YiQrXPb_nYxrUjafgbuUscHxCOZkewPOnyx5KXWGAzCg3iw0QiTz98BPc82zAy0s6IKGlcdfpOd-zJnvRkRIQdFaAN9X8iTTNpNKD2KLAhj09pcMT_ww2c1S9lZrXPoFkKn5vKJRI7lYwB4_Q May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:30:19.913509 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 43620937739e45d3bb7849f98d0e6cce May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:19.916259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '54d4de87-f1c0-4e32-9c17-09a87a23dc55'} May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:19.917758 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. May 17 18:30:19.920060 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:19.921654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-aea00907-b468-42b7-94e1-05bde7a33ec7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Returning 404 to user: Instance 54d4de87-f1c0-4e32-9c17-09a87a23dc55 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:19.921654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-aea00907-b468-42b7-94e1-05bde7a33ec7 tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55" status: 404 len: 111 microversion: 2.20 time: 0.030765 May 17 18:30:19.921654 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 604/1152] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:30:19 2022] GET /compute/v2.1/servers/54d4de87-f1c0-4e32-9c17-09a87a23dc55 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 18:30:21.052808 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-79c8481e-1e32-41f7-a2a7-d4c7eb26de4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:21.053356 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-79c8481e-1e32-41f7-a2a7-d4c7eb26de4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:21.059616 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-79c8481e-1e32-41f7-a2a7-d4c7eb26de4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:21.060689 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-79c8481e-1e32-41f7-a2a7-d4c7eb26de4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:21.061701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-79c8481e-1e32-41f7-a2a7-d4c7eb26de4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:21.062153 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-79c8481e-1e32-41f7-a2a7-d4c7eb26de4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:21.075927 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-79c8481e-1e32-41f7-a2a7-d4c7eb26de4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] HTTP exception thrown: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-79c8481e-1e32-41f7-a2a7-d4c7eb26de4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Request method failure captured: May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: DELETE /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e HTTP/1.1 May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-bK_hOAEprE3oTWKa7r9mpzFeKqR2YiQrXPb_nYxrUjafgbuUscHxCOZkewPOnyx5KXWGAzCg3iw0QiTz98BPc82zAy0s6IKGlcdfpOd-zJnvRkRIQdFaAN9X8iTTNpNKD2KLAhj09pcMT_ww2c1S9lZrXPoFkKn5vKJRI7lYwB4_Q May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:30:21.077547 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 43620937739e45d3bb7849f98d0e6cce May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:30:21.079527 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e'} May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:21.083491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:30:21.084994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:30:21.086665 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-79c8481e-1e32-41f7-a2a7-d4c7eb26de4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Returning 404 to user: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:21.086665 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-79c8481e-1e32-41f7-a2a7-d4c7eb26de4e tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "DELETE /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 404 len: 111 microversion: 2.20 time: 0.030347 May 17 18:30:21.086665 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 549/1153] 10.222.0.65 () {60 vars in 1279 bytes} [Tue May 17 18:30:21 2022] DELETE /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 18:30:21.087931 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ec1eb002-0a59-4253-9233-8207e8fc4e7d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:21.088545 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ec1eb002-0a59-4253-9233-8207e8fc4e7d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] [instance: 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:21.094822 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ec1eb002-0a59-4253-9233-8207e8fc4e7d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:21.095267 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ec1eb002-0a59-4253-9233-8207e8fc4e7d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:21.096037 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ec1eb002-0a59-4253-9233-8207e8fc4e7d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:21.096474 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ec1eb002-0a59-4253-9233-8207e8fc4e7d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:21.110679 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-ec1eb002-0a59-4253-9233-8207e8fc4e7d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] HTTP exception thrown: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ec1eb002-0a59-4253-9233-8207e8fc4e7d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Request method failure captured: May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e HTTP/1.1 May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-bK_hOAEprE3oTWKa7r9mpzFeKqR2YiQrXPb_nYxrUjafgbuUscHxCOZkewPOnyx5KXWGAzCg3iw0QiTz98BPc82zAy0s6IKGlcdfpOd-zJnvRkRIQdFaAN9X8iTTNpNKD2KLAhj09pcMT_ww2c1S9lZrXPoFkKn5vKJRI7lYwB4_Q May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Openstack-Nova-Api-Version: 2.20 May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:30:21.112237 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/379adfd2520a4d2dba04fca7fa3a1d95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 379adfd2520a4d2dba04fca7fa3a1d95 May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-565826877 May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 43620937739e45d3bb7849f98d0e6cce May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-AttachVolumeShelveTestJSON-565826877-project May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:30:21.114038 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e'} May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:30:21.118198 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. May 17 18:30:21.119962 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:30:21.121332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ec1eb002-0a59-4253-9233-8207e8fc4e7d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] Returning 404 to user: Instance 7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:30:21.121332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ec1eb002-0a59-4253-9233-8207e8fc4e7d tempest-AttachVolumeShelveTestJSON-565826877 tempest-AttachVolumeShelveTestJSON-565826877-project] 10.222.0.65 "GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e" status: 404 len: 111 microversion: 2.20 time: 0.029660 May 17 18:30:21.121332 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 605/1154] 10.222.0.65 () {60 vars in 1276 bytes} [Tue May 17 18:30:21 2022] GET /compute/v2.1/servers/7be5ae4c-f5c2-493c-b00a-e1d9dfb0446e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 17 18:30:56.682978 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-55246731-b6f5-4221-86ba-ab36426d5b72 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:56.684722 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-55246731-b6f5-4221-86ba-ab36426d5b72 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:56.697985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-55246731-b6f5-4221-86ba-ab36426d5b72 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:56.698564 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-55246731-b6f5-4221-86ba-ab36426d5b72 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:56.700261 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-55246731-b6f5-4221-86ba-ab36426d5b72 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:56.702006 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-55246731-b6f5-4221-86ba-ab36426d5b72 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:56.740888 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-55246731-b6f5-4221-86ba-ab36426d5b72 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:30:56.864068 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-55246731-b6f5-4221-86ba-ab36426d5b72 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 204 len: 0 microversion: 2.1 time: 0.185089 May 17 18:30:56.865530 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 550/1155] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:30:56 2022] DELETE /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:30:56.874931 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1320b672-fa3c-459c-b7dd-1a388d307f29 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:56.876025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1320b672-fa3c-459c-b7dd-1a388d307f29 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:56.882912 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1320b672-fa3c-459c-b7dd-1a388d307f29 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:56.883713 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1320b672-fa3c-459c-b7dd-1a388d307f29 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:56.884771 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1320b672-fa3c-459c-b7dd-1a388d307f29 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:56.885434 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1320b672-fa3c-459c-b7dd-1a388d307f29 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:57.046042 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-4c916f14-edd8-43d7-81f8-1641fe6ebd75 req-97006269-7e8a-4c5a-a65d-86a3f02d5b39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f5e07c-0b46-457f-b50b-c60529a9ca25", "tag": "55227826-2e6b-4311-b687-c5996676ed3b"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:30:57.060867 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-4c916f14-edd8-43d7-81f8-1641fe6ebd75 req-97006269-7e8a-4c5a-a65d-86a3f02d5b39 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:57.061308 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-4c916f14-edd8-43d7-81f8-1641fe6ebd75 req-97006269-7e8a-4c5a-a65d-86a3f02d5b39 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:57.065113 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1320b672-fa3c-459c-b7dd-1a388d307f29 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:57.076724 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1320b672-fa3c-459c-b7dd-1a388d307f29 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1576 microversion: 2.1 time: 0.205658 May 17 18:30:57.077928 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 551/1156] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:30:56 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:30:57.090442 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-4c916f14-edd8-43d7-81f8-1641fe6ebd75 req-97006269-7e8a-4c5a-a65d-86a3f02d5b39 service nova] Creating event network-changed:55227826-2e6b-4311-b687-c5996676ed3b for instance f5f5e07c-0b46-457f-b50b-c60529a9ca25 on hv-cinder-83736 May 17 18:30:57.095840 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-4c916f14-edd8-43d7-81f8-1641fe6ebd75 req-97006269-7e8a-4c5a-a65d-86a3f02d5b39 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.411690 May 17 18:30:57.096791 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 606/1157] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:30:58.098152 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d813b39a-c8a4-4ccb-b698-0616691e2f82 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:58.099407 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d813b39a-c8a4-4ccb-b698-0616691e2f82 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:58.108372 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d813b39a-c8a4-4ccb-b698-0616691e2f82 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:58.108938 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d813b39a-c8a4-4ccb-b698-0616691e2f82 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:58.109827 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d813b39a-c8a4-4ccb-b698-0616691e2f82 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:58.110488 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d813b39a-c8a4-4ccb-b698-0616691e2f82 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:58.279464 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d813b39a-c8a4-4ccb-b698-0616691e2f82 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:58.291769 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d813b39a-c8a4-4ccb-b698-0616691e2f82 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1576 microversion: 2.1 time: 0.199710 May 17 18:30:58.292368 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 552/1158] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:30:58 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1576 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:30:59.273059 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-71eb6a4b-469a-43c8-b1c3-d7f0a011e32f req-9a651f78-e9e8-4434-a3fb-29906dcf55a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f5e07c-0b46-457f-b50b-c60529a9ca25", "name": "network-vif-deleted", "tag": "55227826-2e6b-4311-b687-c5996676ed3b"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:30:59.283404 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-71eb6a4b-469a-43c8-b1c3-d7f0a011e32f req-9a651f78-e9e8-4434-a3fb-29906dcf55a8 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:59.283849 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-71eb6a4b-469a-43c8-b1c3-d7f0a011e32f req-9a651f78-e9e8-4434-a3fb-29906dcf55a8 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:59.296610 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-71eb6a4b-469a-43c8-b1c3-d7f0a011e32f req-9a651f78-e9e8-4434-a3fb-29906dcf55a8 service nova] Creating event network-vif-deleted:55227826-2e6b-4311-b687-c5996676ed3b for instance f5f5e07c-0b46-457f-b50b-c60529a9ca25 on hv-cinder-83736 May 17 18:30:59.303055 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-71eb6a4b-469a-43c8-b1c3-d7f0a011e32f req-9a651f78-e9e8-4434-a3fb-29906dcf55a8 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034684 May 17 18:30:59.303713 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 607/1159] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:30:59.310261 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-8c122572-8fa5-40b9-af33-ba4eaa92db2c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:30:59.310853 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-8c122572-8fa5-40b9-af33-ba4eaa92db2c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:30:59.329113 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8c122572-8fa5-40b9-af33-ba4eaa92db2c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:59.329640 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8c122572-8fa5-40b9-af33-ba4eaa92db2c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:59.330451 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8c122572-8fa5-40b9-af33-ba4eaa92db2c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:30:59.331102 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-8c122572-8fa5-40b9-af33-ba4eaa92db2c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:30:59.399520 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-8c122572-8fa5-40b9-af33-ba4eaa92db2c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:30:59.407113 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-8c122572-8fa5-40b9-af33-ba4eaa92db2c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 200 len: 1224 microversion: 2.1 time: 0.101324 May 17 18:30:59.407675 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 553/1160] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:30:59 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 1224 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:00.425389 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-269b9a90-2381-4c7e-aee0-13360bfb2170 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:00.426001 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-269b9a90-2381-4c7e-aee0-13360bfb2170 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: f5f5e07c-0b46-457f-b50b-c60529a9ca25] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:00.436620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-269b9a90-2381-4c7e-aee0-13360bfb2170 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:00.437529 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-269b9a90-2381-4c7e-aee0-13360bfb2170 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:00.439740 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-269b9a90-2381-4c7e-aee0-13360bfb2170 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:00.440557 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-269b9a90-2381-4c7e-aee0-13360bfb2170 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:00.469735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-269b9a90-2381-4c7e-aee0-13360bfb2170 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] HTTP exception thrown: Instance f5f5e07c-0b46-457f-b50b-c60529a9ca25 could not be found. May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-269b9a90-2381-4c7e-aee0-13360bfb2170 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Request method failure captured: May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 HTTP/1.1 May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-eD2-mOxBg8kdJ2a8d8L1DGID6lAyLExl47UKOVPwO_QTVwUbKPH6dMMoVL0FVrY_s_D-diCFQzmtClEj5hCNMJ-_2la1rFQ2T8LVSbQaZl4blfqS64FHgF1s5aMJKgmOggo7FYdmgHXrOAhn-7j-2oSog42V8rJIReJ7ce66kdlTw May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 481c26193c6141588dd15fd5c593de86 May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:31:00.472220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_481c26193c6141588dd15fd5c593de86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/481c26193c6141588dd15fd5c593de86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/481c26193c6141588dd15fd5c593de86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/481c26193c6141588dd15fd5c593de86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 481c26193c6141588dd15fd5c593de86 May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-TestVolumeBootPattern-1473396945-project May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 861ad9a7c63a4d66a1806c4576cddce5 May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-TestVolumeBootPattern-1473396945-project May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance f5f5e07c-0b46-457f-b50b-c60529a9ca25 could not be found. May 17 18:31:00.473755 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': 'f5f5e07c-0b46-457f-b50b-c60529a9ca25'} May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f5e07c-0b46-457f-b50b-c60529a9ca25 could not be found. May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:31:00.474936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f5e07c-0b46-457f-b50b-c60529a9ca25 could not be found. May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f5e07c-0b46-457f-b50b-c60529a9ca25 could not be found. May 17 18:31:00.476561 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:31:00.479843 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-269b9a90-2381-4c7e-aee0-13360bfb2170 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Returning 404 to user: Instance f5f5e07c-0b46-457f-b50b-c60529a9ca25 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:31:00.479843 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-269b9a90-2381-4c7e-aee0-13360bfb2170 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25" status: 404 len: 111 microversion: 2.1 time: 0.056079 May 17 18:31:00.479843 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 608/1161] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:00 2022] GET /compute/v2.1/servers/f5f5e07c-0b46-457f-b50b-c60529a9ca25 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:31:03.993934 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-009ad851-f729-4c9e-b7ce-b380a78f056c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:03.995208 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-009ad851-f729-4c9e-b7ce-b380a78f056c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:04.002187 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-009ad851-f729-4c9e-b7ce-b380a78f056c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:04.002883 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-009ad851-f729-4c9e-b7ce-b380a78f056c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:04.003848 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-009ad851-f729-4c9e-b7ce-b380a78f056c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:04.008083 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-009ad851-f729-4c9e-b7ce-b380a78f056c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:04.059707 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-009ad851-f729-4c9e-b7ce-b380a78f056c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Going to try to terminate instance {{(pid=117098) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:31:04.157439 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9113d2e8-8beb-4430-978a-10748cfa1807 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Action: 'create', calling method: .version_select at 0x7f4e60501af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-576936016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLxl9wN+sT/KbLd9/yF8PG5z2ErNR6LOCXzly67sBw07BNbQgUv8qMZbc3eSZxuzExIm+dt9riKz3j+TUZMW64zZdt3oCWesPSFPCqwBXN/U6/rKgBzFU67oIwGhN1bo3A=="}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:31:04.187165 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-9113d2e8-8beb-4430-978a-10748cfa1807 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Getting quotas for project ebc3e65ea59f43f6b93e5fc5aec51e85. Resources: {'key_pairs'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:31:04.190277 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-009ad851-f729-4c9e-b7ce-b380a78f056c tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "DELETE /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 204 len: 0 microversion: 2.1 time: 0.200185 May 17 18:31:04.191625 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 609/1162] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:31:03 2022] DELETE /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:31:04.194431 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-9113d2e8-8beb-4430-978a-10748cfa1807 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Getting quotas for user 2cf9a51b16fd4bfcab91dcd7e4b27492 and project ebc3e65ea59f43f6b93e5fc5aec51e85. Resources: {'key_pairs'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:31:04.197781 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-e919a23c-c403-4d37-bada-1ec7af7edd12 req-c17803a9-f084-4a8e-8857-b409a846e7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e650c1f-7519-4407-8639-e1e14d479102", "tag": "0ec7785c-fbd9-442c-b93d-72558bcf9920"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:31:04.208132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-e919a23c-c403-4d37-bada-1ec7af7edd12 req-c17803a9-f084-4a8e-8857-b409a846e7ee service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:04.208688 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-e919a23c-c403-4d37-bada-1ec7af7edd12 req-c17803a9-f084-4a8e-8857-b409a846e7ee service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:04.223725 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-e919a23c-c403-4d37-bada-1ec7af7edd12 req-c17803a9-f084-4a8e-8857-b409a846e7ee service nova] Creating event network-changed:0ec7785c-fbd9-442c-b93d-72558bcf9920 for instance 4e650c1f-7519-4407-8639-e1e14d479102 on hv-cinder-83736 May 17 18:31:04.229106 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-e919a23c-c403-4d37-bada-1ec7af7edd12 req-c17803a9-f084-4a8e-8857-b409a846e7ee service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035837 May 17 18:31:04.230112 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 610/1163] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:31:04.231236 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9113d2e8-8beb-4430-978a-10748cfa1807 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.341723 May 17 18:31:04.236675 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 554/1164] 10.222.0.65 () {60 vars in 1158 bytes} [Tue May 17 18:31:03 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:31:04.241696 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-19e125f2-e044-44fd-a1c0-99b70bcaf41b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:04.242871 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-19e125f2-e044-44fd-a1c0-99b70bcaf41b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:04.252501 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-19e125f2-e044-44fd-a1c0-99b70bcaf41b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:04.253173 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-19e125f2-e044-44fd-a1c0-99b70bcaf41b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:04.254400 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-19e125f2-e044-44fd-a1c0-99b70bcaf41b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:04.255102 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-19e125f2-e044-44fd-a1c0-99b70bcaf41b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:04.498449 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-19e125f2-e044-44fd-a1c0-99b70bcaf41b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:04.508008 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-19e125f2-e044-44fd-a1c0-99b70bcaf41b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1577 microversion: 2.1 time: 0.276139 May 17 18:31:04.509523 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 611/1165] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:04 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1577 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:05.533631 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2740a9a9-0acb-4828-97fa-630281e1841b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:05.535035 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2740a9a9-0acb-4828-97fa-630281e1841b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:05.543391 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2740a9a9-0acb-4828-97fa-630281e1841b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:05.544746 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2740a9a9-0acb-4828-97fa-630281e1841b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:05.545611 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2740a9a9-0acb-4828-97fa-630281e1841b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:05.546636 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2740a9a9-0acb-4828-97fa-630281e1841b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:05.624400 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2740a9a9-0acb-4828-97fa-630281e1841b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '861ad9a7c63a4d66a1806c4576cddce5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '481c26193c6141588dd15fd5c593de86', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:05.633591 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2740a9a9-0acb-4828-97fa-630281e1841b tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 200 len: 1390 microversion: 2.1 time: 0.107089 May 17 18:31:05.634389 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 555/1166] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:05 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 1390 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:06.258220 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-87d528ea-416e-4be7-8c83-fd3dc0bc41d7 req-c3d08d06-7426-4ec9-a678-0ab82717c78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e650c1f-7519-4407-8639-e1e14d479102", "name": "network-vif-deleted", "tag": "0ec7785c-fbd9-442c-b93d-72558bcf9920"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:31:06.271278 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-87d528ea-416e-4be7-8c83-fd3dc0bc41d7 req-c3d08d06-7426-4ec9-a678-0ab82717c78b service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:06.271981 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-87d528ea-416e-4be7-8c83-fd3dc0bc41d7 req-c3d08d06-7426-4ec9-a678-0ab82717c78b service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:06.285688 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-87d528ea-416e-4be7-8c83-fd3dc0bc41d7 req-c3d08d06-7426-4ec9-a678-0ab82717c78b service nova] Creating event network-vif-deleted:0ec7785c-fbd9-442c-b93d-72558bcf9920 for instance 4e650c1f-7519-4407-8639-e1e14d479102 on hv-cinder-83736 May 17 18:31:06.290773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-87d528ea-416e-4be7-8c83-fd3dc0bc41d7 req-c3d08d06-7426-4ec9-a678-0ab82717c78b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048540 May 17 18:31:06.291811 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 612/1167] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:31:06.651662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6eed5549-eb29-4be9-9cca-a07d90dd3228 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:06.652280 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6eed5549-eb29-4be9-9cca-a07d90dd3228 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 4e650c1f-7519-4407-8639-e1e14d479102] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:06.659041 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6eed5549-eb29-4be9-9cca-a07d90dd3228 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:06.659434 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6eed5549-eb29-4be9-9cca-a07d90dd3228 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:06.660196 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6eed5549-eb29-4be9-9cca-a07d90dd3228 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:06.660634 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6eed5549-eb29-4be9-9cca-a07d90dd3228 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:06.676060 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-6eed5549-eb29-4be9-9cca-a07d90dd3228 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] HTTP exception thrown: Instance 4e650c1f-7519-4407-8639-e1e14d479102 could not be found. May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6eed5549-eb29-4be9-9cca-a07d90dd3228 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Request method failure captured: May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 HTTP/1.1 May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-eD2-mOxBg8kdJ2a8d8L1DGID6lAyLExl47UKOVPwO_QTVwUbKPH6dMMoVL0FVrY_s_D-diCFQzmtClEj5hCNMJ-_2la1rFQ2T8LVSbQaZl4blfqS64FHgF1s5aMJKgmOggo7FYdmgHXrOAhn-7j-2oSog42V8rJIReJ7ce66kdlTw May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 481c26193c6141588dd15fd5c593de86 May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:31:06.677766 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_481c26193c6141588dd15fd5c593de86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/481c26193c6141588dd15fd5c593de86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/481c26193c6141588dd15fd5c593de86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/481c26193c6141588dd15fd5c593de86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 481c26193c6141588dd15fd5c593de86 May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-TestVolumeBootPattern-1473396945-project May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 861ad9a7c63a4d66a1806c4576cddce5 May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-TestVolumeBootPattern-1473396945-project May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 4e650c1f-7519-4407-8639-e1e14d479102 could not be found. May 17 18:31:06.679445 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '4e650c1f-7519-4407-8639-e1e14d479102'} May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e650c1f-7519-4407-8639-e1e14d479102 could not be found. May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:31:06.680347 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e650c1f-7519-4407-8639-e1e14d479102 could not be found. May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e650c1f-7519-4407-8639-e1e14d479102 could not be found. May 17 18:31:06.681992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:31:06.683385 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6eed5549-eb29-4be9-9cca-a07d90dd3228 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Returning 404 to user: Instance 4e650c1f-7519-4407-8639-e1e14d479102 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:31:06.683385 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6eed5549-eb29-4be9-9cca-a07d90dd3228 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102" status: 404 len: 111 microversion: 2.1 time: 0.031388 May 17 18:31:06.683385 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 556/1168] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:06 2022] GET /compute/v2.1/servers/4e650c1f-7519-4407-8639-e1e14d479102 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:31:07.130709 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c6e75693-59e3-4b44-8871-e081fd100069 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:07.131303 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c6e75693-59e3-4b44-8871-e081fd100069 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:07.138043 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6e75693-59e3-4b44-8871-e081fd100069 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:07.138492 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6e75693-59e3-4b44-8871-e081fd100069 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:07.139272 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6e75693-59e3-4b44-8871-e081fd100069 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:07.139706 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c6e75693-59e3-4b44-8871-e081fd100069 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:07.155094 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-c6e75693-59e3-4b44-8871-e081fd100069 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] HTTP exception thrown: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c6e75693-59e3-4b44-8871-e081fd100069 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Request method failure captured: May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: DELETE /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 HTTP/1.1 May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-eD2-mOxBg8kdJ2a8d8L1DGID6lAyLExl47UKOVPwO_QTVwUbKPH6dMMoVL0FVrY_s_D-diCFQzmtClEj5hCNMJ-_2la1rFQ2T8LVSbQaZl4blfqS64FHgF1s5aMJKgmOggo7FYdmgHXrOAhn-7j-2oSog42V8rJIReJ7ce66kdlTw May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: 481c26193c6141588dd15fd5c593de86 May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:31:07.156735 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_481c26193c6141588dd15fd5c593de86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/481c26193c6141588dd15fd5c593de86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/481c26193c6141588dd15fd5c593de86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/481c26193c6141588dd15fd5c593de86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: 481c26193c6141588dd15fd5c593de86 May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-TestVolumeBootPattern-1473396945-project May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 861ad9a7c63a4d66a1806c4576cddce5 May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-TestVolumeBootPattern-1473396945-project May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:31:07.158417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': '6ef769ce-3ca7-4bbd-84dd-567ed0af61b9'} May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:31:07.159314 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:31:07.160677 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:31:07.162309 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c6e75693-59e3-4b44-8871-e081fd100069 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Returning 404 to user: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:31:07.162309 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c6e75693-59e3-4b44-8871-e081fd100069 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "DELETE /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 404 len: 111 microversion: 2.1 time: 0.031679 May 17 18:31:07.162309 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 613/1169] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:31:07 2022] DELETE /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:31:07.166701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1321f24d-a772-47c7-a6b1-16c63b969744 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:07.167321 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1321f24d-a772-47c7-a6b1-16c63b969744 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] [instance: 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:07.174216 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1321f24d-a772-47c7-a6b1-16c63b969744 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:07.174686 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1321f24d-a772-47c7-a6b1-16c63b969744 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:07.175578 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1321f24d-a772-47c7-a6b1-16c63b969744 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:07.176025 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1321f24d-a772-47c7-a6b1-16c63b969744 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:07.190278 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.wsgi [None req-1321f24d-a772-47c7-a6b1-16c63b969744 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] HTTP exception thrown: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1321f24d-a772-47c7-a6b1-16c63b969744 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Request method failure captured: May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: request: GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 HTTP/1.1 May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept: application/json May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Accept-Encoding: identity May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Connection: close May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Length: 0 May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Content-Type: application/json May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Host: 10.222.0.65 May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Openstack-System-Scope: None May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: User-Agent: python-urllib3/1.26.9 May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Auth-Token: gAAAAABig-eD2-mOxBg8kdJ2a8d8L1DGID6lAyLExl47UKOVPwO_QTVwUbKPH6dMMoVL0FVrY_s_D-diCFQzmtClEj5hCNMJ-_2la1rFQ2T8LVSbQaZl4blfqS64FHgF1s5aMJKgmOggo7FYdmgHXrOAhn-7j-2oSog42V8rJIReJ7ce66kdlTw May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Id: None May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Domain-Name: None May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Identity-Status: Confirmed May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Is-Admin-Project: True May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Id: default May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Domain-Name: Default May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Id: 481c26193c6141588dd15fd5c593de86 May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Project-Name: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Role: member,reader May 17 18:31:07.191919 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Roles: member,reader May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_481c26193c6141588dd15fd5c593de86"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/481c26193c6141588dd15fd5c593de86"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/481c26193c6141588dd15fd5c593de86"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/481c26193c6141588dd15fd5c593de86"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Id: 481c26193c6141588dd15fd5c593de86 May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-Tenant-Name: tempest-TestVolumeBootPattern-1473396945 May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User: tempest-TestVolumeBootPattern-1473396945-project May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Id: default May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Domain-Name: Default May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Id: 861ad9a7c63a4d66a1806c4576cddce5 May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: X-User-Name: tempest-TestVolumeBootPattern-1473396945-project May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: method: > May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: exception: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:31:07.193592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: action_args: {'id': '6ef769ce-3ca7-4bbd-84dd-567ed0af61b9'} May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:31:07.194635 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. May 17 18:31:07.195995 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR nova.api.openstack.wsgi May 17 18:31:07.197563 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1321f24d-a772-47c7-a6b1-16c63b969744 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Returning 404 to user: Instance 6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 could not be found. {{(pid=117099) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:31:07.197563 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1321f24d-a772-47c7-a6b1-16c63b969744 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9" status: 404 len: 111 microversion: 2.1 time: 0.030420 May 17 18:31:07.197563 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 557/1170] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:07 2022] GET /compute/v2.1/servers/6ef769ce-3ca7-4bbd-84dd-567ed0af61b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 17 18:31:08.498446 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-eeb6e0cc-4eac-4a8b-a4b5-ed3b5996d479 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] Calling method '.version_select at 0x7f4e5b4ca280>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:08.530539 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-eeb6e0cc-4eac-4a8b-a4b5-ed3b5996d479 tempest-TestVolumeBootPattern-1473396945 tempest-TestVolumeBootPattern-1473396945-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-63217234" status: 202 len: 0 microversion: 2.1 time: 0.036140 May 17 18:31:08.531123 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 614/1171] 10.222.0.65 () {58 vars in 1256 bytes} [Tue May 17 18:31:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-63217234 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:31:14.744761 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:31:14.745276 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Tue May 17 18:31:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:31:26.002100 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1408759638", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-576936016", "security_groups": [{"name": "tempest-secgroup-smoke-950086110"}], "networks": [{"uuid": "fbace396-278d-431c-8207-e07d0d1e0e78"}], "block_device_mapping_v2": [{"uuid": "163b3751-56a2-4210-9aa6-102a77a32bf5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:31:26.111580 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.network.neutron [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] validate_networks() for [('fbace396-278d-431c-8207-e07d0d1e0e78', None, None, None, None, None)] {{(pid=117099) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 17 18:31:26.609079 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Flavor limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 17 18:31:26.609586 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Image limits 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 17 18:31:26.610067 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Flavor pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 17 18:31:26.610507 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Image pref 0:0:0 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 17 18:31:26.610929 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.virt.hardware [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117099) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 17 18:31:26.619437 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:26.619897 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:26.621303 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:26.621790 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:26.637668 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Getting quotas for project ebc3e65ea59f43f6b93e5fc5aec51e85. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 17 18:31:26.641520 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.quota [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Getting quotas for user 2cf9a51b16fd4bfcab91dcd7e4b27492 and project ebc3e65ea59f43f6b93e5fc5aec51e85. Resources: {'instances', 'ram', 'cores'} {{(pid=117099) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 17 18:31:26.696141 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Going to run 1 instances... {{(pid=117099) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 17 18:31:26.698251 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='163b3751-56a2-4210-9aa6-102a77a32bf5',volume_size=None,volume_type=None)] {{(pid=117099) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 17 18:31:26.819725 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4e2cbae5-bdcd-47e7-a116-0f0e6d08d919 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.821523 May 17 18:31:26.820345 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 558/1172] 10.222.0.65 () {60 vars in 1146 bytes} [Tue May 17 18:31:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 17 18:31:26.831110 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-48eb79e7-53d5-4476-84e4-a3093fbbbe76 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:26.831768 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-48eb79e7-53d5-4476-84e4-a3093fbbbe76 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:26.887788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-48eb79e7-53d5-4476-84e4-a3093fbbbe76 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:26.894348 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-48eb79e7-53d5-4476-84e4-a3093fbbbe76 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1088 microversion: 2.1 time: 0.068030 May 17 18:31:26.894905 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 615/1173] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:26 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1088 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:27.911505 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4bd5a71f-ac5d-4d43-aad1-89d696f5b7b6 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:27.912123 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4bd5a71f-ac5d-4d43-aad1-89d696f5b7b6 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:27.920057 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bd5a71f-ac5d-4d43-aad1-89d696f5b7b6 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:27.920508 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bd5a71f-ac5d-4d43-aad1-89d696f5b7b6 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:27.921287 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bd5a71f-ac5d-4d43-aad1-89d696f5b7b6 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:27.921753 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4bd5a71f-ac5d-4d43-aad1-89d696f5b7b6 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:27.987182 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4bd5a71f-ac5d-4d43-aad1-89d696f5b7b6 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:27.994830 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4bd5a71f-ac5d-4d43-aad1-89d696f5b7b6 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1204 microversion: 2.1 time: 0.087721 May 17 18:31:27.995381 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 559/1174] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:27 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1204 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:29.012852 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d2865fb1-7b99-425d-995b-54b78a69e9cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:29.013917 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d2865fb1-7b99-425d-995b-54b78a69e9cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:29.017305 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-52659d4e-2e6f-4986-a644-a47034f93160 req-7142b011-374e-4b22-a788-98520cbab677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f81823-37ba-4649-a5b8-1f8998fe7bd2", "tag": "f833f5d2-871b-45e8-83d5-b0ece2a79fc7"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:31:29.020563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d2865fb1-7b99-425d-995b-54b78a69e9cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:29.021012 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d2865fb1-7b99-425d-995b-54b78a69e9cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:29.022009 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d2865fb1-7b99-425d-995b-54b78a69e9cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:29.022444 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d2865fb1-7b99-425d-995b-54b78a69e9cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:29.036521 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-52659d4e-2e6f-4986-a644-a47034f93160 req-7142b011-374e-4b22-a788-98520cbab677 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:29.047337 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-52659d4e-2e6f-4986-a644-a47034f93160 req-7142b011-374e-4b22-a788-98520cbab677 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:29.060534 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.compute.server_external_events [req-52659d4e-2e6f-4986-a644-a47034f93160 req-7142b011-374e-4b22-a788-98520cbab677 service nova] Creating event network-changed:f833f5d2-871b-45e8-83d5-b0ece2a79fc7 for instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 on hv-cinder-83736 May 17 18:31:29.065739 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-52659d4e-2e6f-4986-a644-a47034f93160 req-7142b011-374e-4b22-a788-98520cbab677 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052159 May 17 18:31:29.066793 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 560/1175] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:31:29.168763 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d2865fb1-7b99-425d-995b-54b78a69e9cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:29.176705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d2865fb1-7b99-425d-995b-54b78a69e9cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1259 microversion: 2.1 time: 0.168417 May 17 18:31:29.177918 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 616/1176] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:29 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:30.195378 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-2cb2a1e0-c2c6-4d74-979c-fb3be814c204 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:30.196081 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-2cb2a1e0-c2c6-4d74-979c-fb3be814c204 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:30.202227 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2cb2a1e0-c2c6-4d74-979c-fb3be814c204 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:30.202684 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2cb2a1e0-c2c6-4d74-979c-fb3be814c204 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:30.203706 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2cb2a1e0-c2c6-4d74-979c-fb3be814c204 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:30.204154 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-2cb2a1e0-c2c6-4d74-979c-fb3be814c204 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:30.334704 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-2cb2a1e0-c2c6-4d74-979c-fb3be814c204 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:30.342657 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-2cb2a1e0-c2c6-4d74-979c-fb3be814c204 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1259 microversion: 2.1 time: 0.151929 May 17 18:31:30.343235 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 561/1177] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:30 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:31:31.358458 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-6d86921a-b8cd-4ebf-a2e1-44d426d665ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:31.359103 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-6d86921a-b8cd-4ebf-a2e1-44d426d665ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:31.365484 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d86921a-b8cd-4ebf-a2e1-44d426d665ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:31.365947 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d86921a-b8cd-4ebf-a2e1-44d426d665ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:31.366705 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d86921a-b8cd-4ebf-a2e1-44d426d665ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:31.367136 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-6d86921a-b8cd-4ebf-a2e1-44d426d665ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:31.496061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-6d86921a-b8cd-4ebf-a2e1-44d426d665ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:31.503431 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-6d86921a-b8cd-4ebf-a2e1-44d426d665ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1259 microversion: 2.1 time: 0.148816 May 17 18:31:31.503992 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 617/1178] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:31 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:32.520141 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0659c5ef-e5dd-4ad7-a034-373996727de0 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:32.520752 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0659c5ef-e5dd-4ad7-a034-373996727de0 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:32.527727 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0659c5ef-e5dd-4ad7-a034-373996727de0 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:32.528176 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0659c5ef-e5dd-4ad7-a034-373996727de0 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:32.528939 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0659c5ef-e5dd-4ad7-a034-373996727de0 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:32.529401 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0659c5ef-e5dd-4ad7-a034-373996727de0 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:32.660010 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0659c5ef-e5dd-4ad7-a034-373996727de0 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:32.667526 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0659c5ef-e5dd-4ad7-a034-373996727de0 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1259 microversion: 2.1 time: 0.151299 May 17 18:31:32.668106 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 562/1179] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:32 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:33.684090 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-a2d18525-9977-4465-b3b3-4174ce1ef479 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:33.684684 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-a2d18525-9977-4465-b3b3-4174ce1ef479 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:33.691195 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a2d18525-9977-4465-b3b3-4174ce1ef479 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:33.691642 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a2d18525-9977-4465-b3b3-4174ce1ef479 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:33.692401 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a2d18525-9977-4465-b3b3-4174ce1ef479 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:33.692843 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-a2d18525-9977-4465-b3b3-4174ce1ef479 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:33.819326 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-a2d18525-9977-4465-b3b3-4174ce1ef479 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:33.827258 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-a2d18525-9977-4465-b3b3-4174ce1ef479 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1259 microversion: 2.1 time: 0.146991 May 17 18:31:33.827812 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 618/1180] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:33 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:34.844150 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3e6bf5dd-e7d3-4ef9-b259-42c943689ed5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:34.844782 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-3e6bf5dd-e7d3-4ef9-b259-42c943689ed5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:34.851257 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3e6bf5dd-e7d3-4ef9-b259-42c943689ed5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:34.851707 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3e6bf5dd-e7d3-4ef9-b259-42c943689ed5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:34.852508 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3e6bf5dd-e7d3-4ef9-b259-42c943689ed5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:34.852951 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3e6bf5dd-e7d3-4ef9-b259-42c943689ed5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:34.982579 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-3e6bf5dd-e7d3-4ef9-b259-42c943689ed5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:34.989772 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-3e6bf5dd-e7d3-4ef9-b259-42c943689ed5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1259 microversion: 2.1 time: 0.149554 May 17 18:31:34.990340 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 563/1181] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:34 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:36.006436 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-dcd05f47-8447-4523-801b-7b12e77d7ac4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:36.007012 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-dcd05f47-8447-4523-801b-7b12e77d7ac4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:36.013325 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dcd05f47-8447-4523-801b-7b12e77d7ac4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:36.013799 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dcd05f47-8447-4523-801b-7b12e77d7ac4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:36.014558 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dcd05f47-8447-4523-801b-7b12e77d7ac4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:36.014994 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-dcd05f47-8447-4523-801b-7b12e77d7ac4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:36.141113 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-dcd05f47-8447-4523-801b-7b12e77d7ac4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:36.148343 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-dcd05f47-8447-4523-801b-7b12e77d7ac4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1259 microversion: 2.1 time: 0.145845 May 17 18:31:36.148900 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 619/1182] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:36 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:37.164895 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-db0de7d0-ee03-43ec-81c8-8e6adf50ce22 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:37.165545 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-db0de7d0-ee03-43ec-81c8-8e6adf50ce22 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:37.171921 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-db0de7d0-ee03-43ec-81c8-8e6adf50ce22 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:37.172381 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-db0de7d0-ee03-43ec-81c8-8e6adf50ce22 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:37.173168 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-db0de7d0-ee03-43ec-81c8-8e6adf50ce22 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:37.173633 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-db0de7d0-ee03-43ec-81c8-8e6adf50ce22 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:37.302424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-db0de7d0-ee03-43ec-81c8-8e6adf50ce22 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:37.310187 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-db0de7d0-ee03-43ec-81c8-8e6adf50ce22 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1259 microversion: 2.1 time: 0.149242 May 17 18:31:37.310748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 564/1183] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:37 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1259 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:38.327500 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-d4930ee4-daf3-40a9-8b37-97b96b43315b tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:38.328041 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-d4930ee4-daf3-40a9-8b37-97b96b43315b tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:38.334701 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d4930ee4-daf3-40a9-8b37-97b96b43315b tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:38.335155 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d4930ee4-daf3-40a9-8b37-97b96b43315b tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:38.335919 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d4930ee4-daf3-40a9-8b37-97b96b43315b tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:38.336360 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-d4930ee4-daf3-40a9-8b37-97b96b43315b tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:38.468190 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-d4930ee4-daf3-40a9-8b37-97b96b43315b tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:38.475485 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-d4930ee4-daf3-40a9-8b37-97b96b43315b tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1259 microversion: 2.1 time: 0.152452 May 17 18:31:38.476051 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 620/1184] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:38 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:39.491402 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0df1cfd1-1444-48f9-be7b-c61ebacd744d tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:39.492014 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0df1cfd1-1444-48f9-be7b-c61ebacd744d tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:39.498339 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0df1cfd1-1444-48f9-be7b-c61ebacd744d tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:39.498792 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0df1cfd1-1444-48f9-be7b-c61ebacd744d tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:39.499554 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0df1cfd1-1444-48f9-be7b-c61ebacd744d tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:39.499994 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0df1cfd1-1444-48f9-be7b-c61ebacd744d tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:39.634050 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0df1cfd1-1444-48f9-be7b-c61ebacd744d tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:39.641314 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0df1cfd1-1444-48f9-be7b-c61ebacd744d tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1259 microversion: 2.1 time: 0.153838 May 17 18:31:39.641910 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 565/1185] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:39 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:39.959229 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-bf1e64d1-1e6b-42d4-8ce8-df0876c6aa37 req-373ea0dc-15a3-41c9-b048-8431f541532b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f81823-37ba-4649-a5b8-1f8998fe7bd2", "name": "network-vif-plugged", "status": "completed", "tag": "f833f5d2-871b-45e8-83d5-b0ece2a79fc7"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:31:39.968557 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-bf1e64d1-1e6b-42d4-8ce8-df0876c6aa37 req-373ea0dc-15a3-41c9-b048-8431f541532b service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:39.969056 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-bf1e64d1-1e6b-42d4-8ce8-df0876c6aa37 req-373ea0dc-15a3-41c9-b048-8431f541532b service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:39.984376 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-bf1e64d1-1e6b-42d4-8ce8-df0876c6aa37 req-373ea0dc-15a3-41c9-b048-8431f541532b service nova] Creating event network-vif-plugged:f833f5d2-871b-45e8-83d5-b0ece2a79fc7 for instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 on hv-cinder-83736 May 17 18:31:39.989295 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-bf1e64d1-1e6b-42d4-8ce8-df0876c6aa37 req-373ea0dc-15a3-41c9-b048-8431f541532b service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033776 May 17 18:31:39.989926 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 621/1186] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:31:40.657938 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-d454ec88-c926-4dec-9bd2-ea4c88a9e79e tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:40.658562 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-d454ec88-c926-4dec-9bd2-ea4c88a9e79e tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:40.664833 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d454ec88-c926-4dec-9bd2-ea4c88a9e79e tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:40.665285 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d454ec88-c926-4dec-9bd2-ea4c88a9e79e tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:40.666082 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d454ec88-c926-4dec-9bd2-ea4c88a9e79e tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:40.666522 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-d454ec88-c926-4dec-9bd2-ea4c88a9e79e tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:40.792043 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-d454ec88-c926-4dec-9bd2-ea4c88a9e79e tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:40.799947 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-d454ec88-c926-4dec-9bd2-ea4c88a9e79e tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1259 microversion: 2.1 time: 0.145970 May 17 18:31:40.800517 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 566/1187] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:40 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1259 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:41.818113 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3faaf052-21c9-49c9-bb16-0ab6163ef318 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:41.818811 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3faaf052-21c9-49c9-bb16-0ab6163ef318 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:41.825467 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3faaf052-21c9-49c9-bb16-0ab6163ef318 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:41.825930 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3faaf052-21c9-49c9-bb16-0ab6163ef318 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:41.826691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3faaf052-21c9-49c9-bb16-0ab6163ef318 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:41.827121 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3faaf052-21c9-49c9-bb16-0ab6163ef318 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:41.958579 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3faaf052-21c9-49c9-bb16-0ab6163ef318 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:41.966065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3faaf052-21c9-49c9-bb16-0ab6163ef318 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1443 microversion: 2.1 time: 0.152700 May 17 18:31:41.966638 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 622/1188] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:41 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:41.981938 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-9d805177-3140-4120-bcf8-e4dec46afff7 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:31:41.982590 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-9d805177-3140-4120-bcf8-e4dec46afff7 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:31:41.988869 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d805177-3140-4120-bcf8-e4dec46afff7 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:41.989325 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d805177-3140-4120-bcf8-e4dec46afff7 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:41.990130 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d805177-3140-4120-bcf8-e4dec46afff7 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:41.990574 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-9d805177-3140-4120-bcf8-e4dec46afff7 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:42.119443 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-9d805177-3140-4120-bcf8-e4dec46afff7 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:31:42.127378 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-9d805177-3140-4120-bcf8-e4dec46afff7 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1443 microversion: 2.1 time: 0.149346 May 17 18:31:42.127940 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 567/1189] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:31:41 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:31:43.785692 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-41edf3a8-b32c-4747-8b8b-10832a3eaf94 req-e5fd3dd9-9c49-4e58-befb-b4735d9323a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f81823-37ba-4649-a5b8-1f8998fe7bd2", "tag": "f833f5d2-871b-45e8-83d5-b0ece2a79fc7"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:31:43.794669 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-41edf3a8-b32c-4747-8b8b-10832a3eaf94 req-e5fd3dd9-9c49-4e58-befb-b4735d9323a7 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:31:43.795385 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-41edf3a8-b32c-4747-8b8b-10832a3eaf94 req-e5fd3dd9-9c49-4e58-befb-b4735d9323a7 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:31:43.806620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-41edf3a8-b32c-4747-8b8b-10832a3eaf94 req-e5fd3dd9-9c49-4e58-befb-b4735d9323a7 service nova] Creating event network-changed:f833f5d2-871b-45e8-83d5-b0ece2a79fc7 for instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 on hv-cinder-83736 May 17 18:31:43.811821 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-41edf3a8-b32c-4747-8b8b-10832a3eaf94 req-e5fd3dd9-9c49-4e58-befb-b4735d9323a7 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029849 May 17 18:31:43.812927 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 623/1190] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:32:32.711858 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:32:32.712604 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Tue May 17 18:32:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:33:57.607222 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7d81c82d-cc21-424c-a714-b3be998589e5] AMQP server on 10.222.0.65:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 17 18:33:57.610962 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-bc2c5705-d916-4ba9-85dd-edc03db092d8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:33:57.611518 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-bc2c5705-d916-4ba9-85dd-edc03db092d8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:33:57.617434 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc2c5705-d916-4ba9-85dd-edc03db092d8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:33:57.617910 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc2c5705-d916-4ba9-85dd-edc03db092d8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:33:57.618670 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc2c5705-d916-4ba9-85dd-edc03db092d8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:33:57.619105 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-bc2c5705-d916-4ba9-85dd-edc03db092d8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:33:57.641203 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.objects.instance [None req-bc2c5705-d916-4ba9-85dd-edc03db092d8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lazy-loading 'flavor' on Instance uuid f1f81823-37ba-4649-a5b8-1f8998fe7bd2 {{(pid=117099) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 17 18:33:57.710215 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-bc2c5705-d916-4ba9-85dd-edc03db092d8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "POST /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.104345 May 17 18:33:57.710805 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 568/1191] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:33:57 2022] POST /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:33:57.717565 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR oslo.messaging._drivers.impl_rabbit [-] [dc2830e9-229e-46de-94a6-3594c202ff45] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 18:33:57.721743 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-bfcba1d7-dc10-4639-92e8-1bb1a4eb87e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:33:57.722482 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-bfcba1d7-dc10-4639-92e8-1bb1a4eb87e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:33:57.730256 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bfcba1d7-dc10-4639-92e8-1bb1a4eb87e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:33:57.730715 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bfcba1d7-dc10-4639-92e8-1bb1a4eb87e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:33:57.731498 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bfcba1d7-dc10-4639-92e8-1bb1a4eb87e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:33:57.731941 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bfcba1d7-dc10-4639-92e8-1bb1a4eb87e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:33:57.968239 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-bfcba1d7-dc10-4639-92e8-1bb1a4eb87e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:33:57.975687 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-bfcba1d7-dc10-4639-92e8-1bb1a4eb87e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.260089 May 17 18:33:57.976248 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 624/1192] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:33:57 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:33:58.994641 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ceb79ca6-bc79-44d4-9242-fb1e30fda707 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:33:58.995354 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ceb79ca6-bc79-44d4-9242-fb1e30fda707 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:33:59.002498 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ceb79ca6-bc79-44d4-9242-fb1e30fda707 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:33:59.002959 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ceb79ca6-bc79-44d4-9242-fb1e30fda707 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:33:59.003740 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ceb79ca6-bc79-44d4-9242-fb1e30fda707 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:33:59.004189 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ceb79ca6-bc79-44d4-9242-fb1e30fda707 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:33:59.007579 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO oslo.messaging._drivers.impl_rabbit [-] [7d81c82d-cc21-424c-a714-b3be998589e5] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57538. May 17 18:33:59.180647 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ceb79ca6-bc79-44d4-9242-fb1e30fda707 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:33:59.188044 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ceb79ca6-bc79-44d4-9242-fb1e30fda707 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.198931 May 17 18:33:59.188606 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 569/1193] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:33:58 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:00.205387 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-876f5b28-1155-4648-8630-90c495b070c8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:00.206020 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-876f5b28-1155-4648-8630-90c495b070c8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:00.213901 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-876f5b28-1155-4648-8630-90c495b070c8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:00.214366 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-876f5b28-1155-4648-8630-90c495b070c8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:00.215145 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-876f5b28-1155-4648-8630-90c495b070c8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:00.215588 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-876f5b28-1155-4648-8630-90c495b070c8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:00.234574 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO oslo.messaging._drivers.impl_rabbit [-] [dc2830e9-229e-46de-94a6-3594c202ff45] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57544. May 17 18:34:00.342830 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-876f5b28-1155-4648-8630-90c495b070c8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:00.350249 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-876f5b28-1155-4648-8630-90c495b070c8 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.149015 May 17 18:34:00.350813 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 625/1194] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:00 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:01.367725 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7fb2eeec-07c4-43cf-aa95-ef10aee39e86 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:01.368342 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7fb2eeec-07c4-43cf-aa95-ef10aee39e86 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:01.374477 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fb2eeec-07c4-43cf-aa95-ef10aee39e86 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:01.374926 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fb2eeec-07c4-43cf-aa95-ef10aee39e86 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:01.375696 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fb2eeec-07c4-43cf-aa95-ef10aee39e86 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:01.376131 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7fb2eeec-07c4-43cf-aa95-ef10aee39e86 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:01.509440 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7fb2eeec-07c4-43cf-aa95-ef10aee39e86 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:01.516812 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7fb2eeec-07c4-43cf-aa95-ef10aee39e86 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.153553 May 17 18:34:01.517369 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 570/1195] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:01 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:02.534396 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-25ee75d4-6ac7-4f4a-8b0c-04a91ef6bf44 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:02.535016 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-25ee75d4-6ac7-4f4a-8b0c-04a91ef6bf44 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:02.541427 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25ee75d4-6ac7-4f4a-8b0c-04a91ef6bf44 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:02.541915 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25ee75d4-6ac7-4f4a-8b0c-04a91ef6bf44 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:02.542684 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25ee75d4-6ac7-4f4a-8b0c-04a91ef6bf44 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:02.543126 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-25ee75d4-6ac7-4f4a-8b0c-04a91ef6bf44 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:02.667811 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-25ee75d4-6ac7-4f4a-8b0c-04a91ef6bf44 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:02.675091 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-25ee75d4-6ac7-4f4a-8b0c-04a91ef6bf44 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.144588 May 17 18:34:02.675650 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 626/1196] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:02 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:03.692860 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-0043827a-6270-4036-9db3-99f7f695c5d2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:03.693653 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-0043827a-6270-4036-9db3-99f7f695c5d2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:03.700519 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0043827a-6270-4036-9db3-99f7f695c5d2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:03.701055 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0043827a-6270-4036-9db3-99f7f695c5d2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:03.701854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0043827a-6270-4036-9db3-99f7f695c5d2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:03.702293 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-0043827a-6270-4036-9db3-99f7f695c5d2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:03.839717 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-0043827a-6270-4036-9db3-99f7f695c5d2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:03.847198 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-0043827a-6270-4036-9db3-99f7f695c5d2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.158527 May 17 18:34:03.847771 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 571/1197] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:03 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:04.864430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-ce29ffef-9bcb-41e2-9d5a-f7d4e389fb78 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:04.865050 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-ce29ffef-9bcb-41e2-9d5a-f7d4e389fb78 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:04.871430 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ce29ffef-9bcb-41e2-9d5a-f7d4e389fb78 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:04.871879 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ce29ffef-9bcb-41e2-9d5a-f7d4e389fb78 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:04.872641 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ce29ffef-9bcb-41e2-9d5a-f7d4e389fb78 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:04.873082 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-ce29ffef-9bcb-41e2-9d5a-f7d4e389fb78 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:04.998800 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-ce29ffef-9bcb-41e2-9d5a-f7d4e389fb78 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:05.006142 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-ce29ffef-9bcb-41e2-9d5a-f7d4e389fb78 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.145576 May 17 18:34:05.006701 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 627/1198] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:04 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:34:06.023930 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-ad419539-8854-42f4-bb58-16c328352e2f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:06.024477 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-ad419539-8854-42f4-bb58-16c328352e2f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:06.030915 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ad419539-8854-42f4-bb58-16c328352e2f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:06.031368 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ad419539-8854-42f4-bb58-16c328352e2f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:06.032132 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ad419539-8854-42f4-bb58-16c328352e2f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:06.032582 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-ad419539-8854-42f4-bb58-16c328352e2f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:06.156998 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-ad419539-8854-42f4-bb58-16c328352e2f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:06.164850 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-ad419539-8854-42f4-bb58-16c328352e2f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.145172 May 17 18:34:06.165419 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 572/1199] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:06 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:07.182417 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-bd1c3a3b-83c5-4f88-af93-565f5ff60edb tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:07.183065 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-bd1c3a3b-83c5-4f88-af93-565f5ff60edb tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:07.189475 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bd1c3a3b-83c5-4f88-af93-565f5ff60edb tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:07.189936 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bd1c3a3b-83c5-4f88-af93-565f5ff60edb tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:07.190706 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bd1c3a3b-83c5-4f88-af93-565f5ff60edb tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:07.191143 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bd1c3a3b-83c5-4f88-af93-565f5ff60edb tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:07.321109 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-bd1c3a3b-83c5-4f88-af93-565f5ff60edb tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:07.328425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-bd1c3a3b-83c5-4f88-af93-565f5ff60edb tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.150474 May 17 18:34:07.328993 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 628/1200] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:07 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:08.345613 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f9b5b843-2a5b-41e7-8727-1e366ab805c2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:08.346254 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-f9b5b843-2a5b-41e7-8727-1e366ab805c2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:08.354119 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9b5b843-2a5b-41e7-8727-1e366ab805c2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:08.354581 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9b5b843-2a5b-41e7-8727-1e366ab805c2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:08.355356 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9b5b843-2a5b-41e7-8727-1e366ab805c2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:08.355798 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-f9b5b843-2a5b-41e7-8727-1e366ab805c2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:08.482888 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-f9b5b843-2a5b-41e7-8727-1e366ab805c2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:08.490164 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f9b5b843-2a5b-41e7-8727-1e366ab805c2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.148566 May 17 18:34:08.490722 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 573/1201] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:08 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:09.508440 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-16b9ca6d-a515-4a9b-827e-56c6ffd072ac tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:09.508985 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-16b9ca6d-a515-4a9b-827e-56c6ffd072ac tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:09.515335 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-16b9ca6d-a515-4a9b-827e-56c6ffd072ac tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:09.515788 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-16b9ca6d-a515-4a9b-827e-56c6ffd072ac tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:09.516556 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-16b9ca6d-a515-4a9b-827e-56c6ffd072ac tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:09.516993 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-16b9ca6d-a515-4a9b-827e-56c6ffd072ac tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:09.645486 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-16b9ca6d-a515-4a9b-827e-56c6ffd072ac tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:09.652796 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-16b9ca6d-a515-4a9b-827e-56c6ffd072ac tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.148956 May 17 18:34:09.653380 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 629/1202] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:09 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:10.670393 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-1f57e512-49f1-4184-a781-fc87535e5b51 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:10.671006 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-1f57e512-49f1-4184-a781-fc87535e5b51 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:10.677479 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1f57e512-49f1-4184-a781-fc87535e5b51 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:10.677962 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1f57e512-49f1-4184-a781-fc87535e5b51 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:10.678725 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1f57e512-49f1-4184-a781-fc87535e5b51 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:10.679265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-1f57e512-49f1-4184-a781-fc87535e5b51 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:10.803677 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-1f57e512-49f1-4184-a781-fc87535e5b51 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:10.813916 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-1f57e512-49f1-4184-a781-fc87535e5b51 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1508 microversion: 2.1 time: 0.147358 May 17 18:34:10.814491 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 574/1203] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:10 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:10.830301 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-916f9033-187d-4799-9c39-b8f154b2428f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:34:10.830901 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-916f9033-187d-4799-9c39-b8f154b2428f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:10.837283 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-916f9033-187d-4799-9c39-b8f154b2428f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:10.837764 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-916f9033-187d-4799-9c39-b8f154b2428f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:10.838529 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-916f9033-187d-4799-9c39-b8f154b2428f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:10.838967 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-916f9033-187d-4799-9c39-b8f154b2428f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:10.967331 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-916f9033-187d-4799-9c39-b8f154b2428f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "POST /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.141063 May 17 18:34:10.967862 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 630/1204] 10.222.0.65 () {60 vars in 1277 bytes} [Tue May 17 18:34:10 2022] POST /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:34:10.975892 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-3de52e61-44d9-4b7d-9562-ac80b20ede74 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:10.976513 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-3de52e61-44d9-4b7d-9562-ac80b20ede74 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:10.982933 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3de52e61-44d9-4b7d-9562-ac80b20ede74 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:10.983400 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3de52e61-44d9-4b7d-9562-ac80b20ede74 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:10.984174 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3de52e61-44d9-4b7d-9562-ac80b20ede74 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:10.984683 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-3de52e61-44d9-4b7d-9562-ac80b20ede74 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:11.113866 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-3de52e61-44d9-4b7d-9562-ac80b20ede74 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:11.121220 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-3de52e61-44d9-4b7d-9562-ac80b20ede74 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1516 microversion: 2.1 time: 0.149175 May 17 18:34:11.121825 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 575/1205] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:10 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:12.139156 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-2c7abf1f-3d93-4aaf-9cbc-7cb8ea62b1c4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:12.139891 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-2c7abf1f-3d93-4aaf-9cbc-7cb8ea62b1c4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:12.145802 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2c7abf1f-3d93-4aaf-9cbc-7cb8ea62b1c4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:12.146251 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2c7abf1f-3d93-4aaf-9cbc-7cb8ea62b1c4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:12.147076 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2c7abf1f-3d93-4aaf-9cbc-7cb8ea62b1c4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:12.147512 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-2c7abf1f-3d93-4aaf-9cbc-7cb8ea62b1c4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:12.275143 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-2c7abf1f-3d93-4aaf-9cbc-7cb8ea62b1c4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:12.282472 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-2c7abf1f-3d93-4aaf-9cbc-7cb8ea62b1c4 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1516 microversion: 2.1 time: 0.147689 May 17 18:34:12.283036 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 631/1206] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:12 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:12.792288 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [req-7c9154dc-9c22-4a72-9988-6375ff473857 req-06e21064-d5de-4210-9bc4-0bd03aad14fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f81823-37ba-4649-a5b8-1f8998fe7bd2", "name": "network-vif-unplugged", "status": "completed", "tag": "f833f5d2-871b-45e8-83d5-b0ece2a79fc7"}]} {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:34:12.800407 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-7c9154dc-9c22-4a72-9988-6375ff473857 req-06e21064-d5de-4210-9bc4-0bd03aad14fc service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:12.800971 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [req-7c9154dc-9c22-4a72-9988-6375ff473857 req-06e21064-d5de-4210-9bc4-0bd03aad14fc service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:12.814662 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.compute.server_external_events [req-7c9154dc-9c22-4a72-9988-6375ff473857 req-06e21064-d5de-4210-9bc4-0bd03aad14fc service nova] Unable to find a host for instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2. Dropping event network-vif-unplugged {{(pid=117099) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 17 18:34:12.815678 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [req-7c9154dc-9c22-4a72-9988-6375ff473857 req-06e21064-d5de-4210-9bc4-0bd03aad14fc service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.085728 May 17 18:34:12.816282 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 576/1207] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 17 18:34:13.299716 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-4e98f7fe-1f89-4401-a1e6-7722b0f483ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:13.300358 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-4e98f7fe-1f89-4401-a1e6-7722b0f483ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:13.306642 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4e98f7fe-1f89-4401-a1e6-7722b0f483ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:13.307093 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4e98f7fe-1f89-4401-a1e6-7722b0f483ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:13.307855 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4e98f7fe-1f89-4401-a1e6-7722b0f483ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:13.308287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-4e98f7fe-1f89-4401-a1e6-7722b0f483ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:13.434319 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-4e98f7fe-1f89-4401-a1e6-7722b0f483ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:13.442002 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-4e98f7fe-1f89-4401-a1e6-7722b0f483ae tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1516 microversion: 2.1 time: 0.146151 May 17 18:34:13.442563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 632/1208] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:13 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1516 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:14.458959 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4d4501da-d8a6-48c4-9b6f-ecb888f596da tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:14.459592 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4d4501da-d8a6-48c4-9b6f-ecb888f596da tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:14.466669 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4d4501da-d8a6-48c4-9b6f-ecb888f596da tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:14.467122 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4d4501da-d8a6-48c4-9b6f-ecb888f596da tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:14.467892 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4d4501da-d8a6-48c4-9b6f-ecb888f596da tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:14.468334 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4d4501da-d8a6-48c4-9b6f-ecb888f596da tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:14.596649 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4d4501da-d8a6-48c4-9b6f-ecb888f596da tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:14.603957 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4d4501da-d8a6-48c4-9b6f-ecb888f596da tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1516 microversion: 2.1 time: 0.149148 May 17 18:34:14.604550 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 577/1209] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:14 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:15.623490 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-3ca26ee7-8b71-41cb-a086-fc858c06901a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:15.624224 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-3ca26ee7-8b71-41cb-a086-fc858c06901a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:15.631073 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ca26ee7-8b71-41cb-a086-fc858c06901a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:15.631713 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ca26ee7-8b71-41cb-a086-fc858c06901a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:15.632526 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ca26ee7-8b71-41cb-a086-fc858c06901a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:15.632942 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-3ca26ee7-8b71-41cb-a086-fc858c06901a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:15.763388 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-3ca26ee7-8b71-41cb-a086-fc858c06901a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:15.771792 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-3ca26ee7-8b71-41cb-a086-fc858c06901a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1518 microversion: 2.1 time: 0.153345 May 17 18:34:15.772347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 633/1210] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:15 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:16.789321 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a6c8d224-a2d8-484e-afd3-196822e85651 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:16.789992 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a6c8d224-a2d8-484e-afd3-196822e85651 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:16.796249 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6c8d224-a2d8-484e-afd3-196822e85651 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:16.796701 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6c8d224-a2d8-484e-afd3-196822e85651 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:16.797523 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6c8d224-a2d8-484e-afd3-196822e85651 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:16.797931 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a6c8d224-a2d8-484e-afd3-196822e85651 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:16.933676 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a6c8d224-a2d8-484e-afd3-196822e85651 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:16.941354 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a6c8d224-a2d8-484e-afd3-196822e85651 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1574 microversion: 2.1 time: 0.155883 May 17 18:34:16.941959 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 578/1211] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:16 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:17.959052 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-e0cf7195-4bb9-417b-b126-55162f2bd929 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:17.959597 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-e0cf7195-4bb9-417b-b126-55162f2bd929 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:17.966472 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e0cf7195-4bb9-417b-b126-55162f2bd929 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:17.966924 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e0cf7195-4bb9-417b-b126-55162f2bd929 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:17.967686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e0cf7195-4bb9-417b-b126-55162f2bd929 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:17.968125 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-e0cf7195-4bb9-417b-b126-55162f2bd929 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:18.095518 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-e0cf7195-4bb9-417b-b126-55162f2bd929 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:18.102844 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-e0cf7195-4bb9-417b-b126-55162f2bd929 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1574 microversion: 2.1 time: 0.148034 May 17 18:34:18.103403 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 634/1212] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:17 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:19.120242 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-757357bc-7fb0-435c-8217-486fe7400297 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:19.120787 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-757357bc-7fb0-435c-8217-486fe7400297 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:19.127078 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-757357bc-7fb0-435c-8217-486fe7400297 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:19.127529 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-757357bc-7fb0-435c-8217-486fe7400297 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:19.128292 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-757357bc-7fb0-435c-8217-486fe7400297 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:19.128730 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-757357bc-7fb0-435c-8217-486fe7400297 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:19.257623 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-757357bc-7fb0-435c-8217-486fe7400297 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:19.264885 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-757357bc-7fb0-435c-8217-486fe7400297 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1574 microversion: 2.1 time: 0.149195 May 17 18:34:19.265449 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 579/1213] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:19 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:20.281479 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-f54162cb-3909-4db3-b09e-a24c39bd14ee tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:20.282104 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-f54162cb-3909-4db3-b09e-a24c39bd14ee tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:20.288502 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f54162cb-3909-4db3-b09e-a24c39bd14ee tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:20.288950 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f54162cb-3909-4db3-b09e-a24c39bd14ee tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:20.290250 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f54162cb-3909-4db3-b09e-a24c39bd14ee tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:20.290691 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-f54162cb-3909-4db3-b09e-a24c39bd14ee tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:20.419503 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-f54162cb-3909-4db3-b09e-a24c39bd14ee tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:20.426756 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-f54162cb-3909-4db3-b09e-a24c39bd14ee tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1574 microversion: 2.1 time: 0.149172 May 17 18:34:20.427319 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 635/1214] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:20 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1574 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:21.444101 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7051ff00-ab76-4537-9b2e-1114e7b5417f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:21.444746 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7051ff00-ab76-4537-9b2e-1114e7b5417f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:21.451679 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7051ff00-ab76-4537-9b2e-1114e7b5417f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:21.452126 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7051ff00-ab76-4537-9b2e-1114e7b5417f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:21.452895 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7051ff00-ab76-4537-9b2e-1114e7b5417f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:21.453333 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7051ff00-ab76-4537-9b2e-1114e7b5417f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:21.578926 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7051ff00-ab76-4537-9b2e-1114e7b5417f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:21.586638 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7051ff00-ab76-4537-9b2e-1114e7b5417f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1574 microversion: 2.1 time: 0.146424 May 17 18:34:21.587204 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 580/1215] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:21 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1574 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:22.603889 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-5ee8ac7a-267d-47cc-9328-e0496b5f059a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:22.604521 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-5ee8ac7a-267d-47cc-9328-e0496b5f059a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:22.610881 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5ee8ac7a-267d-47cc-9328-e0496b5f059a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:22.611328 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5ee8ac7a-267d-47cc-9328-e0496b5f059a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:22.612083 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5ee8ac7a-267d-47cc-9328-e0496b5f059a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:22.612517 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-5ee8ac7a-267d-47cc-9328-e0496b5f059a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:22.740231 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-5ee8ac7a-267d-47cc-9328-e0496b5f059a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:22.747577 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-5ee8ac7a-267d-47cc-9328-e0496b5f059a tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1574 microversion: 2.1 time: 0.147694 May 17 18:34:22.748137 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 636/1216] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:22 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:23.764310 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-b17e4ce2-a15c-41eb-a56a-cfd77622fa42 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:23.764949 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-b17e4ce2-a15c-41eb-a56a-cfd77622fa42 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:23.771341 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b17e4ce2-a15c-41eb-a56a-cfd77622fa42 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:23.771789 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b17e4ce2-a15c-41eb-a56a-cfd77622fa42 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:23.772550 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b17e4ce2-a15c-41eb-a56a-cfd77622fa42 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:23.772985 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-b17e4ce2-a15c-41eb-a56a-cfd77622fa42 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:23.909424 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-b17e4ce2-a15c-41eb-a56a-cfd77622fa42 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:23.917584 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-b17e4ce2-a15c-41eb-a56a-cfd77622fa42 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1574 microversion: 2.1 time: 0.157256 May 17 18:34:23.918165 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 581/1217] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:23 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:24.924132 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:34:24.924647 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Tue May 17 18:34:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:34:24.934863 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-bcbcd165-371b-4768-be4a-60c9cc9575e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:24.935463 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-bcbcd165-371b-4768-be4a-60c9cc9575e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:24.941838 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bcbcd165-371b-4768-be4a-60c9cc9575e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:24.942287 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bcbcd165-371b-4768-be4a-60c9cc9575e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:24.943057 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bcbcd165-371b-4768-be4a-60c9cc9575e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:24.943495 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-bcbcd165-371b-4768-be4a-60c9cc9575e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:25.070780 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-bcbcd165-371b-4768-be4a-60c9cc9575e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:25.078100 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-bcbcd165-371b-4768-be4a-60c9cc9575e9 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1574 microversion: 2.1 time: 0.147279 May 17 18:34:25.078656 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 637/1218] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:24 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1574 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:26.095311 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-4708bd96-43dd-4aa9-aae8-118328c40747 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:26.095839 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-4708bd96-43dd-4aa9-aae8-118328c40747 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:26.102215 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4708bd96-43dd-4aa9-aae8-118328c40747 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:26.102673 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4708bd96-43dd-4aa9-aae8-118328c40747 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:26.103443 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4708bd96-43dd-4aa9-aae8-118328c40747 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:26.103886 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-4708bd96-43dd-4aa9-aae8-118328c40747 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:26.230031 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-4708bd96-43dd-4aa9-aae8-118328c40747 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:26.243374 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-4708bd96-43dd-4aa9-aae8-118328c40747 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1574 microversion: 2.1 time: 0.151922 May 17 18:34:26.243964 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 582/1219] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:26 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:26.844264 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-619a5bf8-1a08-4669-929e-d4829f26320b req-f905b25e-706b-4ab1-b603-4abd8ce09e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f81823-37ba-4649-a5b8-1f8998fe7bd2", "name": "network-vif-plugged", "status": "completed", "tag": "f833f5d2-871b-45e8-83d5-b0ece2a79fc7"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:34:26.853630 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-619a5bf8-1a08-4669-929e-d4829f26320b req-f905b25e-706b-4ab1-b603-4abd8ce09e98 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:26.854073 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-619a5bf8-1a08-4669-929e-d4829f26320b req-f905b25e-706b-4ab1-b603-4abd8ce09e98 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:26.864880 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-619a5bf8-1a08-4669-929e-d4829f26320b req-f905b25e-706b-4ab1-b603-4abd8ce09e98 service nova] Creating event network-vif-plugged:f833f5d2-871b-45e8-83d5-b0ece2a79fc7 for instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 on hv-cinder-83736 May 17 18:34:26.868541 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR oslo.messaging._drivers.impl_rabbit [req-619a5bf8-1a08-4669-929e-d4829f26320b req-f905b25e-706b-4ab1-b603-4abd8ce09e98 service nova] [9d8ce720-6008-4d57-b052-299af1f9b762] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 18:34:27.260414 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-e22d9861-bb89-48cc-94d4-10707e690149 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:27.261039 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-e22d9861-bb89-48cc-94d4-10707e690149 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:27.267403 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e22d9861-bb89-48cc-94d4-10707e690149 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:27.267854 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e22d9861-bb89-48cc-94d4-10707e690149 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:27.268624 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e22d9861-bb89-48cc-94d4-10707e690149 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:27.269063 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-e22d9861-bb89-48cc-94d4-10707e690149 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:27.393665 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-e22d9861-bb89-48cc-94d4-10707e690149 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:27.401441 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-e22d9861-bb89-48cc-94d4-10707e690149 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1574 microversion: 2.1 time: 0.145039 May 17 18:34:27.402026 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 583/1220] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:27 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1574 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:34:27.875482 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO oslo.messaging._drivers.impl_rabbit [req-619a5bf8-1a08-4669-929e-d4829f26320b req-f905b25e-706b-4ab1-b603-4abd8ce09e98 service nova] [9d8ce720-6008-4d57-b052-299af1f9b762] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57632. May 17 18:34:27.878925 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-619a5bf8-1a08-4669-929e-d4829f26320b req-f905b25e-706b-4ab1-b603-4abd8ce09e98 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.038992 May 17 18:34:27.879528 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 638/1221] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:34:28.418281 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-dd63e885-8a40-453f-8288-e4ad726e4728 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:28.418907 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-dd63e885-8a40-453f-8288-e4ad726e4728 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:28.425265 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dd63e885-8a40-453f-8288-e4ad726e4728 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:28.425748 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dd63e885-8a40-453f-8288-e4ad726e4728 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:28.426516 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dd63e885-8a40-453f-8288-e4ad726e4728 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:28.426957 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-dd63e885-8a40-453f-8288-e4ad726e4728 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:28.805144 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-dd63e885-8a40-453f-8288-e4ad726e4728 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:28.812505 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-dd63e885-8a40-453f-8288-e4ad726e4728 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1574 microversion: 2.1 time: 0.398112 May 17 18:34:28.813066 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 584/1222] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:28 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1574 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:29.830631 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-b2b2a3ed-819e-47cb-a93e-0838ad3f02a2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:34:29.831362 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-b2b2a3ed-819e-47cb-a93e-0838ad3f02a2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:34:29.837557 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b2b2a3ed-819e-47cb-a93e-0838ad3f02a2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:29.838009 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b2b2a3ed-819e-47cb-a93e-0838ad3f02a2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:29.838773 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b2b2a3ed-819e-47cb-a93e-0838ad3f02a2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:34:29.839206 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-b2b2a3ed-819e-47cb-a93e-0838ad3f02a2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:34:29.966986 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-b2b2a3ed-819e-47cb-a93e-0838ad3f02a2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:34:29.974350 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-b2b2a3ed-819e-47cb-a93e-0838ad3f02a2 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1561 microversion: 2.1 time: 0.148674 May 17 18:34:29.974914 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 639/1223] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:34:29 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:34:34.755508 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:34:34.756104 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Tue May 17 18:34:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:35:57.566779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-6dccfe7c-ac65-4516-8fb6-cc9cd5fa33cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:35:57.567438 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6dccfe7c-ac65-4516-8fb6-cc9cd5fa33cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:35:57.574037 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6dccfe7c-ac65-4516-8fb6-cc9cd5fa33cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:35:57.574487 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6dccfe7c-ac65-4516-8fb6-cc9cd5fa33cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:35:57.575264 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6dccfe7c-ac65-4516-8fb6-cc9cd5fa33cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:35:57.575779 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-6dccfe7c-ac65-4516-8fb6-cc9cd5fa33cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:35:57.604144 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-6dccfe7c-ac65-4516-8fb6-cc9cd5fa33cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Going to try to terminate instance {{(pid=117099) delete /opt/stack/nova/nova/compute/api.py:2664}} May 17 18:35:57.627694 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-7ecdf40c-41cb-4e9e-8e7f-b2d1d6a75045 req-4505f1e6-7121-42cc-b2a6-288060bd4845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f81823-37ba-4649-a5b8-1f8998fe7bd2", "tag": "f833f5d2-871b-45e8-83d5-b0ece2a79fc7"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:35:57.635846 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-7ecdf40c-41cb-4e9e-8e7f-b2d1d6a75045 req-4505f1e6-7121-42cc-b2a6-288060bd4845 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:35:57.636373 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-7ecdf40c-41cb-4e9e-8e7f-b2d1d6a75045 req-4505f1e6-7121-42cc-b2a6-288060bd4845 service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:35:57.648425 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-7ecdf40c-41cb-4e9e-8e7f-b2d1d6a75045 req-4505f1e6-7121-42cc-b2a6-288060bd4845 service nova] Creating event network-changed:f833f5d2-871b-45e8-83d5-b0ece2a79fc7 for instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 on hv-cinder-83736 May 17 18:35:57.654495 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-7ecdf40c-41cb-4e9e-8e7f-b2d1d6a75045 req-4505f1e6-7121-42cc-b2a6-288060bd4845 service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090067 May 17 18:35:57.655162 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 640/1224] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 17 18:35:57.695596 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-6dccfe7c-ac65-4516-8fb6-cc9cd5fa33cc tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "DELETE /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 204 len: 0 microversion: 2.1 time: 0.131077 May 17 18:35:57.695596 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 585/1225] 10.222.0.65 () {58 vars in 1238 bytes} [Tue May 17 18:35:57 2022] DELETE /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 17 18:35:57.703214 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-c11e5390-a7e5-4732-b203-53f695877267 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:35:57.704270 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-c11e5390-a7e5-4732-b203-53f695877267 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:35:57.711448 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c11e5390-a7e5-4732-b203-53f695877267 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:35:57.711897 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c11e5390-a7e5-4732-b203-53f695877267 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:35:57.712686 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c11e5390-a7e5-4732-b203-53f695877267 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:35:57.713120 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-c11e5390-a7e5-4732-b203-53f695877267 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:35:57.851886 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.policy [None req-c11e5390-a7e5-4732-b203-53f695877267 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117098) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:35:57.859955 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-c11e5390-a7e5-4732-b203-53f695877267 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.161137 May 17 18:35:57.860708 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 641/1226] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:35:57 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 17 18:35:58.877400 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-a2149f8e-efca-497a-bdab-220914755f8f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:35:58.878146 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-a2149f8e-efca-497a-bdab-220914755f8f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:35:58.885720 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a2149f8e-efca-497a-bdab-220914755f8f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:35:58.886182 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a2149f8e-efca-497a-bdab-220914755f8f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:35:58.887042 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a2149f8e-efca-497a-bdab-220914755f8f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:35:58.887494 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-a2149f8e-efca-497a-bdab-220914755f8f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:35:59.018780 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-a2149f8e-efca-497a-bdab-220914755f8f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:35:59.026258 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-a2149f8e-efca-497a-bdab-220914755f8f tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1567 microversion: 2.1 time: 0.153198 May 17 18:35:59.026823 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 586/1227] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:35:58 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:35:59.854290 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [req-17938b8d-4605-4121-9859-b8eafbcf07e5 req-b19f8002-ca7d-48bd-ba2e-a7a920f286fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f81823-37ba-4649-a5b8-1f8998fe7bd2", "name": "network-vif-deleted", "tag": "f833f5d2-871b-45e8-83d5-b0ece2a79fc7"}]} {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 17 18:35:59.862538 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-17938b8d-4605-4121-9859-b8eafbcf07e5 req-b19f8002-ca7d-48bd-ba2e-a7a920f286fb service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:35:59.862966 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [req-17938b8d-4605-4121-9859-b8eafbcf07e5 req-b19f8002-ca7d-48bd-ba2e-a7a920f286fb service nova] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:35:59.876544 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.compute.server_external_events [req-17938b8d-4605-4121-9859-b8eafbcf07e5 req-b19f8002-ca7d-48bd-ba2e-a7a920f286fb service nova] Creating event network-vif-deleted:f833f5d2-871b-45e8-83d5-b0ece2a79fc7 for instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 on hv-cinder-83736 May 17 18:35:59.881362 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [req-17938b8d-4605-4121-9859-b8eafbcf07e5 req-b19f8002-ca7d-48bd-ba2e-a7a920f286fb service nova] 10.222.0.65 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088531 May 17 18:35:59.881982 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 642/1228] 10.222.0.65 () {64 vars in 1317 bytes} [Tue May 17 18:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 17 18:36:00.042737 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-7ad8bc09-5ed5-4fa2-bb66-a005e25e55e3 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:36:00.043421 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.compute.api [None req-7ad8bc09-5ed5-4fa2-bb66-a005e25e55e3 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117099) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:36:00.049972 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ad8bc09-5ed5-4fa2-bb66-a005e25e55e3 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:36:00.050432 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ad8bc09-5ed5-4fa2-bb66-a005e25e55e3 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:36:00.051222 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ad8bc09-5ed5-4fa2-bb66-a005e25e55e3 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:36:00.051668 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG oslo_concurrency.lockutils [None req-7ad8bc09-5ed5-4fa2-bb66-a005e25e55e3 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117099) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:36:00.124811 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.policy [None req-7ad8bc09-5ed5-4fa2-bb66-a005e25e55e3 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cf9a51b16fd4bfcab91dcd7e4b27492', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc3e65ea59f43f6b93e5fc5aec51e85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117099) authorize /opt/stack/nova/nova/policy.py:199}} May 17 18:36:00.132989 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-7ad8bc09-5ed5-4fa2-bb66-a005e25e55e3 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 200 len: 1219 microversion: 2.1 time: 0.094115 May 17 18:36:00.133950 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 587/1229] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:36:00 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 17 18:36:01.151603 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-795503a2-0fee-40d5-af3d-ef781f6362b5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '>' {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:36:01.152313 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.compute.api [None req-795503a2-0fee-40d5-af3d-ef781f6362b5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [instance: f1f81823-37ba-4649-a5b8-1f8998fe7bd2] Fetching instance by UUID {{(pid=117098) get /opt/stack/nova/nova/compute/api.py:2920}} May 17 18:36:01.159157 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-795503a2-0fee-40d5-af3d-ef781f6362b5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:36:01.159610 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-795503a2-0fee-40d5-af3d-ef781f6362b5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:36:01.160374 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-795503a2-0fee-40d5-af3d-ef781f6362b5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 17 18:36:01.160811 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG oslo_concurrency.lockutils [None req-795503a2-0fee-40d5-af3d-ef781f6362b5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Lock "fc8af911-08c4-433f-ae77-a63829b3d3e3" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117098) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 17 18:36:01.173750 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.wsgi [None req-795503a2-0fee-40d5-af3d-ef781f6362b5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] HTTP exception thrown: Instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 could not be found. May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-795503a2-0fee-40d5-af3d-ef781f6362b5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Request method failure captured: May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: request: GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 HTTP/1.1 May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept: application/json May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Accept-Encoding: identity May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Connection: close May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Length: 0 May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Content-Type: application/json May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Host: 10.222.0.65 May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Openstack-System-Scope: None May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: User-Agent: python-urllib3/1.26.9 May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Auth-Token: gAAAAABig-niX3A0ha2GpLGb5v5UsfsE4rle3MC2q813uQHDUSF31HhlyMfmSdMOVhZruDU5PUOloPl-P93DvGEWmT07xyVKaHplPbfcDKDnf8EU63VZnSpdPykX5s6rFznWoTmSWNf9cqZAyzwgyACxlsBDUE-n9L1uVZt9-vmlqIn4kZIz2D4 May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Id: None May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Domain-Name: None May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Identity-Status: Confirmed May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Is-Admin-Project: True May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Id: default May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Domain-Name: Default May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Id: ebc3e65ea59f43f6b93e5fc5aec51e85 May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Project-Name: tempest-TestShelveInstance-678370935 May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Role: member,reader May 17 18:36:01.175347 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Roles: member,reader May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.65:8080", "publicURL": "http://10.222.0.65:8080/v1/AUTH_ebc3e65ea59f43f6b93e5fc5aec51e85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebc3e65ea59f43f6b93e5fc5aec51e85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2/ebc3e65ea59f43f6b93e5fc5aec51e85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/volume/v3/ebc3e65ea59f43f6b93e5fc5aec51e85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.65/placement"}]}] May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant: tempest-TestShelveInstance-678370935 May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Id: ebc3e65ea59f43f6b93e5fc5aec51e85 May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-Tenant-Name: tempest-TestShelveInstance-678370935 May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User: tempest-TestShelveInstance-678370935-project May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Id: default May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Domain-Name: Default May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Id: 2cf9a51b16fd4bfcab91dcd7e4b27492 May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: X-User-Name: tempest-TestShelveInstance-678370935-project May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: method: > May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: exception: Instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 could not be found. May 17 18:36:01.177259 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: action_args: {'id': 'f1f81823-37ba-4649-a5b8-1f8998fe7bd2'} May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: {{(pid=117098) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 could not be found. May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 17 18:36:01.178450 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 could not be found. May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 could not be found. May 17 18:36:01.180245 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: ERROR nova.api.openstack.wsgi May 17 18:36:01.181841 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: DEBUG nova.api.openstack.wsgi [None req-795503a2-0fee-40d5-af3d-ef781f6362b5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Returning 404 to user: Instance f1f81823-37ba-4649-a5b8-1f8998fe7bd2 could not be found. {{(pid=117098) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 17 18:36:01.181841 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO nova.api.openstack.requestlog [None req-795503a2-0fee-40d5-af3d-ef781f6362b5 tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2" status: 404 len: 111 microversion: 2.1 time: 0.029807 May 17 18:36:01.181841 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: [pid: 117098|app: 0|req: 643/1230] 10.222.0.65 () {58 vars in 1235 bytes} [Tue May 17 18:36:01 2022] GET /compute/v2.1/servers/f1f81823-37ba-4649-a5b8-1f8998fe7bd2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 17 18:36:01.335530 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: DEBUG nova.api.openstack.wsgi [None req-f0717e03-d87b-4652-abdf-c0babb43a3ce tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] Calling method '.version_select at 0x7f4e60512280>' {{(pid=117099) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 17 18:36:01.339739 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f0717e03-d87b-4652-abdf-c0babb43a3ce tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [b00b5c2f-fdae-4eaa-a090-4c8881eebf1d] AMQP server on 10.222.0.65:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 17 18:36:02.347207 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO oslo.messaging._drivers.impl_rabbit [None req-f0717e03-d87b-4652-abdf-c0babb43a3ce tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] [b00b5c2f-fdae-4eaa-a090-4c8881eebf1d] Reconnected to AMQP server on 10.222.0.65:5672 via [amqp] client with port 57706. May 17 18:36:02.365088 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO nova.api.openstack.requestlog [None req-f0717e03-d87b-4652-abdf-c0babb43a3ce tempest-TestShelveInstance-678370935 tempest-TestShelveInstance-678370935-project] 10.222.0.65 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-576936016" status: 202 len: 0 microversion: 2.1 time: 1.033889 May 17 18:36:02.365702 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: [pid: 117099|app: 0|req: 588/1231] 10.222.0.65 () {58 vars in 1250 bytes} [Tue May 17 18:36:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-576936016 => generated 0 bytes in 1035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 17 18:37:44.934061 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:37:44.934604 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Tue May 17 18:37:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:37:54.765022 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:37:54.765666 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Tue May 17 18:37:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:38:05.472705 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:38:05.473421 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Tue May 17 18:38:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:39:12.723678 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:39:12.724281 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Tue May 17 18:39:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:41:04.942971 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:41:04.943563 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Tue May 17 18:41:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:41:04.975874 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:41:04.976320 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Tue May 17 18:41:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:41:14.774310 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:41:14.774960 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Tue May 17 18:41:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:41:16.178620 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:41:16.179179 dv-cinder-837362-2-iscsi devstack@n-api.service[117098]: Tue May 17 18:41:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 17 18:41:25.481422 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 17 18:41:25.482006 dv-cinder-837362-2-iscsi devstack@n-api.service[117099]: Tue May 17 18:41:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!